Actads. In this paper, I introduce a new generalization of the concept of an operad, further generalizing the concept of an opetope introduced by Baez and Dolan, who used this for the definition of their version of non strict n categories. Opetopes arise from iterating a certain construction on operads called the construction, starting with monoids. The first step gives rise to plain operads, i.e. operads without symmetries. The permutation axiom in a symmetric operad, however, is an additional structure resulting from permutation of variables, independent of the structure of a monoid. Even though we can apply the construction to symmetric operads, there is the possibility of introducing a completely different kind of permutations on the higher levels by again permuting variables without regard to the structure on the previous levels. Defining and investigating these structures is the main purpose of this paper. The structures obtained in this way is what I call n actads. In n actads with n 1 , the permutations on the different levels give rise to a certain special kind of n fold category. I also explore the concept of iterated algebras over an n actad (generalizing an algebra and module over an operad), and various types of iterated units. I give some examples of algebras over 2 actads, and show how they can be used to construct certain new interesting homotopy types of operads. I also discuss a connection between actads and ordinal notation.


A note on modular Terwilliger algebras of association schemes. Let p denote a prime number. In this note, we focus on the modular Terwilliger algebras of association schemes defined in 3 . We define the primary module of a modular Terwilliger algebra of an association scheme and determine all its composition factors up to isomorphism. We then characterize the p' valenced association schemes by some properties of their modular Terwilliger algebras. The corollaries about the modular Terwilliger algebras of association schemes are given.


Deep Subjecthood Higher Order Grammatical Features in Multilingual BERT. We investigate how Multilingual BERT (mBERT) encodes grammar by examining how the high order grammatical feature of morphosyntactic alignment (how different languages define what counts as a "subject") is manifested across the embedding spaces of different languages. To understand if and how morphosyntactic alignment affects contextual embedding spaces, we train classifiers to recover the subjecthood of mBERT embeddings in transitive sentences (which do not contain overt information about morphosyntactic alignment) and then evaluate them zero shot on intransitive sentences (where subjecthood classification depends on alignment), within and across languages. We find that the resulting classifier distributions reflect the morphosyntactic alignment of their training languages. Our results demonstrate that mBERT representations are influenced by high level grammatical features that are not manifested in any one input sentence, and that this is robust across languages. Further examining the characteristics that our classifiers rely on, we find that features such as passive voice, animacy and case strongly correlate with classification decisions, suggesting that mBERT does not encode subjecthood purely syntactically, but that subjecthood embedding is continuous and dependent on semantic and discourse factors, as is proposed in much of the functional linguistics literature. Together, these results provide insight into how grammatical features manifest in contextual embedding spaces, at a level of abstraction not covered by previous work.


Cross Camera Feature Prediction for Intra Camera Supervised Person Re identification across Distant Scenes. Person re identification (Re ID) aims to match person images across non overlapping camera views. The majority of Re ID methods focus on small scale surveillance systems in which each pedestrian is captured in different camera views of adjacent scenes. However, in large scale surveillance systems that cover larger areas, it is required to track a pedestrian of interest across distant scenes (e.g., a criminal suspect escapes from one city to another). Since most pedestrians appear in limited local areas, it is difficult to collect training data with cross camera pairs of the same person. In this work, we study intra camera supervised person re identification across distant scenes (ICS DS Re ID), which uses cross camera unpaired data with intra camera identity labels for training. It is challenging as cross camera paired data plays a crucial role for learning camera invariant features in most existing Re ID methods. To learn camera invariant representation from cross camera unpaired training data, we propose a cross camera feature prediction method to mine cross camera self supervision information from camera specific feature distribution by transforming fake cross camera positive feature pairs and minimize the distances of the fake pairs. Furthermore, we automatically localize and extract local level feature by a transformer. Joint learning of global level and local level features forms a global local cross camera feature prediction scheme for mining fine grained cross camera self supervision information. Finally, cross camera self supervision and intra camera supervision are aggregated in a framework. The experiments are conducted in the ICS DS setting on Market SCT, Duke SCT and MSMT17 SCT datasets. The evaluation results demonstrate the superiority of our method, which gains significant improvements of 15.4 Rank 1 and 22.3 mAP on Market SCT as compared to the second best method.


An Approach for the Automation of IaaS Cloud Upgrade. An Infrastructure as a Service (IaaS) cloud provider is committed to each tenant by a service level agreement (SLA) which indicates the terms of commitment, e.g. the level of availability of the IaaS cloud service.The different resources providing this IaaS cloud service may need to be upgraded several times throughout their life cycle and these upgrades may affect the service delivered by the IaaS layer. This may violate the SLAs towards the tenants and result in penalty as they impact the tenant services relying on the IaaS.Therefore, it is important to handle upgrades properly with respect to the SLAs.The upgrade of IaaS cloud systems inherits all the challenges of clustered systems and faces other, cloud specific challenges, such as size and dynamicity due to elasticity.In this paper, we propose a novel approach to automatically upgrade an IaaS cloud system under SLA constraints such as availability and elasticity.In this approach, the upgrade methods and actions appropriate for each upgrade request are identified, scheduled, and applied automatically in an iterative manner based on the vendors descriptions of the infrastructure components, the tenant SLAs, and the status of the system. The proposed approach allows new upgrade requests during ongoing upgrades, which makes it suitable for continuous delivery.In addition, it also handles failures of upgrade actions through localized retry and undo operations automatically.


Iterative Krylov Methods for Acoustic Problems on Graphics Processing Unit. This paper deals with linear algebra operations on Graphics Processing Unit (GPU) with complex number arithmetic using double precision. An analysis of their uses within iterative Krylov methods is presented to solve acoustic problems. Numerical experiments performed on a set of acoustic matrices arising from the modelisation of acoustic phenomena inside a car compartment are collected, and outline the performance, robustness and effectiveness of our algorithms, with a speed up up to 28x for dot product, 9.8x for sparse matrix vector product and solvers.


Chatbots language design the influence of language variation on user experience. Chatbots are often designed to mimic social roles attributed to humans. However, little is known about the impact on user's perceptions of using language that fails to conform to the associated social role. Our research draws on sociolinguistic theory to investigate how a chatbot's language choices can adhere to the expected social role the agent performs within a given context. In doing so, we seek to understand whether chatbots design should account for linguistic register. This research analyzes how register differences play a role in shaping the user's perception of the human chatbot interaction. Ultimately, we want to determine whether register specific language influences users' perceptions and experiences with chatbots. We produced parallel corpora of conversations in the tourism domain with similar content and varying register characteristics and evaluated users' preferences of chatbot's linguistic choices in terms of appropriateness, credibility, and user experience. Our results show that register characteristics are strong predictors of user's preferences, which points to the needs of designing chatbots with register appropriate language to improve acceptance and users' perceptions of chatbot interactions.


High Throughput and Energy Efficient VLSI Architecture for Ordered Reliability Bits GRAND. Ultra reliable low latency communication (URLLC), a major 5G New Radio use case, is the key enabler for applications with strict reliability and latency requirements. These applications necessitate the use of short length and high rate codes. Guessing Random Additive Noise Decoding (GRAND) is a recently proposed Maximum Likelihood (ML) decoding technique for these short length and high rate codes. Rather than decoding the received vector, GRAND tries to infer the noise that corrupted the transmitted codeword during transmission through the communication channel. As a result, GRAND can decode any code, structured or unstructured. GRAND has hard input as well as soft input variants. Among these variants, Ordered Reliability Bits GRAND (ORBGRAND) is a soft input variant that outperforms hard input GRAND and is suitable for parallel hardware implementation. This work reports the first hardware architecture for ORBGRAND, which achieves an average throughput of up to 42.5 Gbps for a code length of 128 at a target FER of 10 7 . Furthermore, the proposed hardware can be used to decode any code as long as the length and rate constraints are met. In comparison to the GRANDAB, a hard input variant of GRAND, the proposed architecture enhances decoding performance by at least 2 dB. When compared to the state of the art fast dynamic successive cancellation flip decoder (Fast DSCF) using a 5G polar (128,105) code, the proposed ORBGRAND VLSI implementation has 49 times higher average throughput, 32 times times more energy efficiency, and 5 times more area efficiency while maintaining similar decoding performance.


A Systematic Literature Review on Process Aware Recommender Systems. Considering processes of a business in a recommender system is highly advantageous. Although most studies in the business process analysis domain are of descriptive and predictive nature, the feasibility of constructing a process aware recommender system is assessed in a few works. One reason can be the lack of knowledge on process mining potential for recommendation problems. Therefore, this paper aims to identify and analyze the published studies on process aware recommender system techniques in business process management and process mining domain. A systematic review was conducted on 33 academic articles published between 2008 and 2020 according to several aspects. In this regard, we provide a state of the art review with critical details and researchers with a better perception of which path to pursue in this field. Moreover, based on a knowledge base and holistic perspective, we discuss some research gaps and open challenges in this field.


Noise induced network bursts and coherence in a calcium mediated neural network. Noise induced population bursting has been widely identified to play important roles in the information process. We constructed a mathematical model for a random and sparse neural network where bursting can be induced from the resting state by the global stochastic stimulus. Importantly, the noise induced bursting dynamics of this network are mediated by calcium conductance. We use two spectral measures to evaluate the network coherence in the context of network bursts, the spike trains of all neurons and the individual bursts of all neurons. Our results show that the coherence of the network is optimized by an optimal level of stochastic stimulus, which is known as coherence resonance (CR). We also demonstrate that the interplay of calcium conductance and noise intensity can modify the degree of CR.


Non terrestrial Communications Assisted by Reconfigurable Intelligent Surfaces. Non terrestrial communications have emerged as a key enabler for seamless connectivity in the upcoming generation networks. This kind of network can support high data rate communications among aerial platforms (i.e., unmanned aerial vehicles (UAVs), high altitude platforms (HAPs), and satellites) and cellular networks, achieving anywhere and anytime connections. However, there are many practical implementation limitations, especially overload power consumption, high probability of blockage, and dynamic propagation environment. Fortunately, the recent technology reconfigurable intelligent surface (RIS) is expected to be one of the most cost efficient solutions to address such issues. RIS with low cost elements can bypass blockages and create multiple line of sight (LoS) links, and provide controllable communication channels. In this paper, we present a comprehensive literature review on the RIS assisted non terrestrial networks (RANTNs). Firstly, the framework of the RANTNs is introduced with detailed discussion about distinct properties of RIS in NTNs and the two types of RIS, that is, terrestrial RISs (TRISs), and aerial RISs (ARISs), and the classification of RANTNs including RIS assisted air to ground (A2G) ground to air (G2A), ARIS assisted ground to ground (G2G), and RIS assisted air to air (A2A) communications. In combination with next generation communication technologies, the advanced technologies in RANTNs are discussed. Then we overview the literature related to RANTNs from the perspectives of performance analysis and optimization, followed by the widely used methodologies. Finally, open challenges and future research direction in the context of the RANTNs are highlighted.


A strongly universal cellular automaton on the heptagrid with seven states. In this paper, we prove that there is a strongly universal cellular automaton on the heptagrid with seven states which is rotation invariant. This improves a previous paper of the author where the automaton required ten states.


Graph toughness from Laplacian eigenvalues. The toughness t(G) of a graph G (V,E) is defined as t(G) min frac S c(G S) , in which the minimum is taken over all S subset V such that G S is disconnected, where c(G S) denotes the number of components of G S . We present two tight lower bounds for t(G) in terms of the Laplacian eigenvalues and provide strong support for a conjecture for a better bound which, if true, implies both bounds, and improves and generalizes known bounds by Alon, Brouwer, and the first author. As applications, several new results on perfect matchings, factors and walks from Laplacian eigenvalues are obtained, which leads to a conjecture about Hamiltonicity and Laplacian eigenvalues.


Efficient computations with counting functions on free groups and free monoids. We present efficient algorithms to decide whether two given counting functions on non abelian free groups or monoids are at bounded distance from each other and to decide whether two given counting quasimorphisms on non abelian free groups are cohomologous. We work in the multi tape Turing machine model with non constant time arithmetic operations. In the case of integer coefficients we construct an algorithm of linear space and time complexity (assuming that the rank is at least 3 in the monoid case). In the case of rational coefficients we prove that the time complexity is O(N log N) , where N denotes the size of the input, i.e. it is as fast as addition of rational numbers (implemented using the Harvey van der Hoeven algorithm for integer multiplication). These algorithms are based on our previous work which characterizes bounded counting functions.


Cold Atmospheric Plasma Sterilization of FFP3 Face Masks and Long Term Material Effects. The use of cold atmospheric plasmas (CAP) to sterilize sensitive surfaces is an interesting new field of applied plasma physics. Motivated by the shortages of face masks and safety clothing at the beginning of the corona pandemic, we conducted studies on the sterilization of FF3 face masks with CAP and the resulting material effects. Therefore, the bactericidal and sporicidal efficacy of CAP afterglow sterilization of FFP3 mask material was investigated by inoculating fabric samples with test germs Escherichia coli (E. coli) and Bacillus atrophaeus (B. atrophaeus) and subsequent CAP afterglow treatment in a surface micro discharge (SMD) plasma device. In addition, a detailed analysis of the changes in long term plasma treated (15h) mask material and its individual components ethylene vinyl acetate (EVA) and polypropylene (PP) was carried out using surface analysis methods such as laser microscopy, contact angle measurements, X ray photoelectron spectroscopy (XPS) as well as fabric permeability and resistance measurements. The experiments showed that E. coli and B. atrophaeus could both be effectively inactivated by plasma treatment in nitrogen mode (12 kVpp, 5 kHz). For B. atrophaeus inactivation of more than 4 log was achieved after 30 minutes. E. coli population could be reduced by 5 log within one minute of CAP treatment and after five minutes a complete inactivation ( 6 log) was achieved. Material analysis showed that long term ( 5 h) plasma treatment affects the electrostatic properties of the fabric. From this it can be deduced that the plasma treatment of FFP3 face masks with the CAP afterglow of an SMD device effectively inactivates microorganisms on the fabric. FFP3 masks can be plasma decontaminated and reused multiple times but only to a limited extent, as otherwise the permeability levels no longer meet the DIN EN 149 specifications.


AI Native Network Slicing for 6G Networks. With the global roll out of the fifth generation (5G) networks, it is necessary to look beyond 5G and envision the 6G networks. The 6G networks are expected to have space air ground integrated networks, advanced network virtualization, and ubiquitous intelligence. This article presents an artificial intelligence (AI) native network slicing architecture for 6G networks to enable the synergy of AI and network slicing, thereby facilitating intelligent network management and supporting emerging AI services. AI based solutions are first discussed across network slicing lifecycle to intelligently manage network slices, i.e., AI for slicing. Then, network slicing solutions are studied to support emerging AI services by constructing AI instances and performing efficient resource management, i.e., slicing for AI. Finally, a case study is presented, followed by a discussion of open research issues that are essential for AI native network slicing in 6G networks.


Central limit theorem for linear spectral statistics of block Wigner type matrices. Motivated by the stochastic block model, we investigate a class of Wigner type matrices with certain block structures, and establish a CLT for the corresponding linear spectral statistics via the large deviation bounds from local law and the cumulant expansion formula. We apply the results to the stochastic block model. Specifically, a class of renormalized adjacency matrices will be block Wigner type matrices. Further, we show that for certain estimator of such renormalized adjacency matrices, which will be no longer Wigner type but share long range non decaying weak correlations among the entries, the linear spectral statistics of such estimators will still share the same limiting behavior as those of the block Wigner type matrices, thus enabling hypothesis testing about stochastic block model.


Estimating Parkinsonism Severity in Natural Gait Videos of Older Adults with Dementia. Drug induced parkinsonism affects many older adults with dementia, often causing gait disturbances. New advances in vision based human pose estimation have opened possibilities for frequent and unobtrusive analysis of gait in residential settings. This work leverages novel spatial temporal graph convolutional network (ST GCN) architectures and training procedures to predict clinical scores of parkinsonism in gait from video of individuals with dementia. We propose a two stage training approach consisting of a self supervised pretraining stage that encourages the ST GCN model to learn about gait patterns before predicting clinical scores in the finetuning stage. The proposed ST GCN models are evaluated on joint trajectories extracted from video and are compared against traditional (ordinal, linear, random forest) regression models and temporal convolutional network baselines. Three 2D human pose estimation libraries (OpenPose, Detectron, AlphaPose) and the Microsoft Kinect (2D and 3D) are used to extract joint trajectories of 4787 natural walking bouts from 53 older adults with dementia. A subset of 399 walks from 14 participants is annotated with scores of parkinsonism severity on the gait criteria of the Unified Parkinson's Disease Rating Scale (UPDRS) and the Simpson Angus Scale (SAS). Our results demonstrate that ST GCN models operating on 3D joint trajectories extracted from the Kinect consistently outperform all other models and feature sets. Prediction of parkinsonism scores in natural walking bouts of unseen participants remains a challenging task, with the best models achieving macro averaged F1 scores of 0.53 0.03 and 0.40 0.02 for UPDRS gait and SAS gait, respectively. Pre trained model and demo code for this work is available https github.com TaatiTeam stgcn parkinsonism prediction.


Do people's user types change over time? An exploratory study. In recent years, different studies have proposed and validated user models (e.g., Bartle, BrainHex, and Hexad) to represent the different user profiles in games and gamified settings. However, the results of applying these user models in practice (e.g., to personalize gamified systems) are still contradictory. One of the hypotheses for these results is that the user types can change over time (i.e., user types are dynamic). To start to understand whether user types can change over time, we conducted an exploratory study analyzing data from 74 participants to identify if their user type (Achiever, Philanthropist, Socialiser, Free Spirit, Player, and Disruptor) had changed over time (six months). The results indicate that there is a change in the dominant user type of the participants, as well as the average scores in the Hexad sub scales. These results imply that all the scores should be considered when defining the Hexad's user type and that the user types are dynamic. Our results contribute with practical implications, indicating that the personalization currently made (generally static) may be insufficient to improve the users' experience, requiring user types to be analyzed continuously and personalization to be done dynamically.


Improving Multi Party Dialogue Discourse Parsing via Domain Integration. While multi party conversations are often less structured than monologues and documents, they are implicitly organized by semantic level correlations across the interactive turns, and dialogue discourse analysis can be applied to predict the dependency structure and relations between the elementary discourse units, and provide feature rich structural information for downstream tasks. However, the existing corpora with dialogue discourse annotation are collected from specific domains with limited sample sizes, rendering the performance of data driven approaches poor on incoming dialogues without any domain adaptation. In this paper, we first introduce a Transformer based parser, and assess its cross domain performance. We next adopt three methods to gain domain integration from both data and language modeling perspectives to improve the generalization capability. Empirical results show that the neural parser can benefit from our proposed methods, and performs better on cross domain dialogue samples.


End to End Software Engineering Research. End to end learning is machine learning starting in raw data and predicting a desired concept, with all steps done automatically. In software engineering context, we see it as starting from the source code and predicting process metrics. This framework can be used for predicting defects, code quality, productivity and more. End to end improves over features based machine learning by not requiring domain experts and being able to extract new knowledge. We describe a dataset of 5M files from 15k projects constructed for this goal. The dataset is constructed in a way that enables not only predicting concepts but also investigating their causes.


PointShuffleNet Learning Non Euclidean Features with Homotopy Equivalence and Mutual Information. Point cloud analysis is still a challenging task due to the disorder and sparsity of samplings of their geometric structures from 3D sensors. In this paper, we introduce the homotopy equivalence relation (HER) to make the neural networks learn the data distribution from a high dimension manifold. A shuffle operation is adopted to construct HER for its randomness and zero parameter. In addition, inspired by prior works, we propose a local mutual information regularizer (LMIR) to cut off the trivial path that leads to a classification error from HER. LMIR utilizes mutual information to measure the distance between the original feature and HER transformed feature and learns common features in a contrastive learning scheme. Thus, we combine HER and LMIR to give our model the ability to learn non Euclidean features from a high dimension manifold. This is named the non Euclidean feature learner. Furthermore, we propose a new heuristics and efficiency point sampling algorithm named ClusterFPS to obtain approximate uniform sampling but at faster speed. ClusterFPS uses a cluster algorithm to divide a point cloud into several clusters and deploy the farthest point sampling algorithm on each cluster in parallel. By combining the above methods, we propose a novel point cloud analysis neural network called PointShuffleNet (PSN), which shows great promise in point cloud classification and segmentation. Extensive experiments show that our PSN achieves state of the art results on ModelNet40, ShapeNet and S3DIS with high efficiency. Theoretically, we provide mathematical analysis toward understanding of what the data distribution HER has developed and why LMIR can drop the trivial path by maximizing mutual information implicitly.


Characterizing Malicious URL Campaigns. URLs are central to a myriad of cyber security threats, from phishing to the distribution of malware. Their inherent ease of use and familiarity is continuously abused by attackers to evade defences and deceive end users. Seemingly dissimilar URLs are being used in an organized way to perform phishing attacks and distribute malware. We refer to such behaviours as campaigns, with the hypothesis being that attacks are often coordinated to maximize success rates and develop evasion tactics. The aim is to gain better insights into campaigns, bolster our grasp of their characteristics, and thus aid the community devise more robust solutions. To this end, we performed extensive research and analysis into 311M records containing 77M unique real world URLs that were submitted to VirusTotal from Dec 2019 to Jan 2020. From this dataset, 2.6M suspicious campaigns were identified based on their attached metadata, of which 77,810 were doubly verified as malicious. Using the 38.1M records and 9.9M URLs within these malicious campaigns, we provide varied insights such as their targeted victim brands as well as URL sizes and heterogeneity. Some surprising findings were observed, such as detection rates falling to just 13.27 for campaigns that employ more than 100 unique URLs. The paper concludes with several case studies that illustrate the common malicious techniques employed by attackers to imperil users and circumvent defences.


Bernstein Spaces on Siegel CR Manifolds. In this paper we introduce and study Bernstein spaces on a class of quadratic CR manifolds, that we call Siegel CR manifolds. These are spaces of entire functions of exponential type whose restrictions to a given Siegel CR submanifold are L p integrable with respect to a natural measure. For these spaces, among other results, we prove the Plancherel P 'olya inequality, a Bernstein inequality and a sufficient condition for a sequence to be sampling.


A resource efficient method for repeated HPO and NAS problems. In this work we consider the problem of repeated hyperparameter and neural architecture search (HNAS). We propose an extension of Successive Halving that is able to leverage information gained in previous HNAS problems with the goal of saving computational resources. We empirically demonstrate that our solution is able to drastically decrease costs while maintaining accuracy and being robust to negative transfer. Our method is significantly simpler than competing transfer learning approaches, setting a new baseline for transfer learning in HNAS.


physics.comp-ph cs.LG cs.NA math.NA physics.flu-dyn

A Modified Batch Intrinsic Plasticity Method for Pre training the Random Coefficients of Extreme Learning Machines. In extreme learning machines (ELM) the hidden layer coefficients are randomly set and fixed, while the output layer coefficients of the neural network are computed by a least squares method. The randomly assigned coefficients in ELM are known to influence its performance and accuracy significantly. In this paper we present a modified batch intrinsic plasticity (modBIP) method for pre training the random coefficients in the ELM neural networks. The current method is devised based on the same principle as the batch intrinsic plasticity (BIP) method, namely, by enhancing the information transmission in every node of the neural network. It differs from BIP in two prominent aspects. First, modBIP does not involve the activation function in its algorithm, and it can be applied with any activation function in the neural network. In contrast, BIP employs the inverse of the activation function in its construction, and requires the activation function to be invertible (or monotonic). The modBIP method can work with the often used non monotonic activation functions (e.g. Gaussian, swish, Gaussian error linear unit, and radial basis type functions), with which BIP breaks down. Second, modBIP generates target samples on random intervals with a minimum size, which leads to highly accurate computation results when combined with ELM. The combined ELM modBIP method is markedly more accurate than ELM BIP in numerical simulations. Ample numerical experiments are presented with shallow and deep neural networks for function approximation and boundary initial value problems with partial differential equations. They demonstrate that the combined ELM modBIP method produces highly accurate simulation results, and that its accuracy is insensitive to the random coefficient initializations in the neural network. This is in sharp contrast with the ELM results without pre training of the random coefficients.


Properties of solutions to Pell's equation over the polynomial ring. In the classical theory, a famous by product of the continued fraction expansion of quadratic irrational numbers sqrt D is the solution to Pell's equation for D . It is well known that, once an integer solution to Pell's equation exists, we can use it to generate all other solutions (u n,v n) n in Zee . Our object of interest is the polynomial version of Pell's equation, where the integers are replaced by polynomials with complex coefficients. We then investigate the factors of v n(t) . In particular, we show that over the complex polynomials, there are only finitely many values of n for which v n(t) has a repeated root. Restricting our analysis to Qee t , we give an upper bound on the number of "new" factors of v n(t) of degree at most N . Furthermore, we show that all "new" linear rational factors of v n(t) can be found when n leq 3 , and all "new" quadratic rational factors when n leq 6 .


Four Dimensional Steady Gradient Ricci Solitons with 3 Cylindrical Tangent Flows at Infinity. In this paper we consider 4 dimensional steady soliton singularity models, i.e., complete steady gradient Ricci solitons that arise as the rescaled limit of a finite time singular solution of the Ricci flow on a closed 4 manifold. In particular, we study the geometry at infinity of such Ricci solitons under the assumption that their tangent flow at infinity is the product of mathbb R with a 3 dimensional spherical space form. We also classify the tangent flows at infinity of 4 dimensional steady soliton singularity models in general.


Different kinds of cognitive plausibility why are transformers better than RNNs at predicting N400 amplitude?. Despite being designed for performance rather than cognitive plausibility, transformer language models have been found to be better at predicting metrics used to assess human language comprehension than language models with other architectures, such as recurrent neural networks. Based on how well they predict the N400, a neural signal associated with processing difficulty, we propose and provide evidence for one possible explanation their predictions are affected by the preceding context in a way analogous to the effect of semantic facilitation in humans.


Asymptotic expansions of Stekloff eigenvalues for perturbations of inhomogeneous media. Eigenvalues arising in scattering theory have been envisioned as a potential source of target signatures in nondestructive testing of materials, whereby perturbations of the eigenvalues computed for a penetrable medium would be used to infer changes in its constitutive parameters relative to some reference values. We consider a recently introduced modification of the class of Stekloff eigenvalues, in which the inclusion of a smoothing operator guarantees that infinitely many eigenvalues exist under minimal assumptions on the medium, and we derive precise formulas that quantify the perturbation of a simple eigenvalue in terms of the coefficients of a perturbed inhomogeneous medium. These formulas rely on the theory of nonlinear eigenvalue approximation and regularity results for elliptic boundary value problems with heterogeneous coefficients, the latter of which is shown to have a strong influence on the sensitivity of the eigenvalues corresponding to an anisotropic medium. A simple numerical example in two dimensions is used to verify the estimates and suggest future directions of study.


Predictive Control Using Learned State Space Models via Rolling Horizon Evolution. A large part of the interest in model based reinforcement learning derives from the potential utility to acquire a forward model capable of strategic long term decision making. Assuming that an agent succeeds in learning a useful predictive model, it still requires a mechanism to harness it to generate and select among competing simulated plans. In this paper, we explore this theme combining evolutionary algorithmic planning techniques with models learned via deep learning and variational inference. We demonstrate the approach with an agent that reliably performs online planning in a set of visual navigation tasks.


Stable a posteriori LES of 2D turbulence using convolutional neural networks Backscattering analysis and generalization to higher Re via transfer learning. There is a growing interest in developing data driven subgrid scale (SGS) models for large eddy simulation (LES) using machine learning (ML). In a priori (offline) tests, some recent studies have found ML based data driven SGS models that are trained on high fidelity data (e.g., from direct numerical simulation, DNS) to outperform baseline physics based models and accurately capture the inter scale transfers, both forward (diffusion) and backscatter. While promising, instabilities in a posteriori (online) tests and inabilities to generalize to a different flow (e.g., with a higher Reynolds number, Re) remain as major obstacles in broadening the applications of such data driven SGS models. For example, many of the same aforementioned studies have found instabilities that required often ad hoc remedies to stabilize the LES at the expense of reducing accuracy. Here, using 2D decaying turbulence as the testbed, we show that deep fully convolutional neural networks (CNNs) can accurately predict the SGS forcing terms and the inter scale transfers in a priori tests, and if trained with enough samples, lead to stable and accurate a posteriori LES CNN. Further analysis attributes these instabilities to the disproportionally lower accuracy of the CNNs in capturing backscattering when the training set is small. We also show that transfer learning, which involves re training the CNN with a small amount of data (e.g., 1 ) from the new flow, enables accurate and stable a posteriori LES CNN for flows with 16x higher Re (as well as higher grid resolution if needed). These results show the promise of CNNs with transfer learning to provide stable, accurate, and generalizable LES for practical use.


An implementation of ROS Autonomous Navigation on Parallax Eddie platform. This paper presents an implementation of autonomous navigation functionality based on Robot Operating System (ROS) on a wheeled differential drive mobile platform called Eddie robot. ROS is a framework that contains many reusable software stacks as well as visualization and debugging tools that provides an ideal environment for any robotic project development. The main contribution of this paper is the description of the customized hardware and software system setup of Eddie robot to work with an autonomous navigation system in ROS called Navigation Stack and to implement one application use case for autonomous navigation. For this paper, photo taking is chosen to demonstrate a use case of the mobile robot.


Vibrational quality classification of metallic turbine blades under measurement uncertainty. Non destructive testing on metallic turbine blades is a challenging task due to their complex geometry. Vibrational test ing such as Process Compensated Resonance Testing (PCRT) has shown an efficient approach, which first measures the vibrational response of the turbine blades, and then employs a classifier to determine if the quality of the turbine blades are good or bad. Our previous work mainly concentrated on the development of Mahalanobis distance based classifiers which are fed by the measured vibrational features (such as resonant frequencies). In practice, however, measurement errors could lead to a biased trained classifier, potentially resulting in the wrong quality classifications of the turbine blade. In this study, we investigate the classification problem of turbine blades under measurement uncertainty. For this, the concept of Interval Mahalanobis Space is employed, leading to the Integrated Interval Mahalanobis Classification system (IIMCS) classifier which has high robustness against measurement uncertainty. The IIMCS employs Binary Particle Swarm Optimization (BPSO) to filter out those resonant frequencies which contrib ute most to the information in the system. A Monte Carlo Simulation scheme is employed to analyze the sensitivity of the resonant frequencies to the measurement uncertainty. This yields an indicator of reliability, indicating the confidence level of the final classification results. The developed IIMCS methodology is applied to an experimental case study of equiaxed nickel alloy first stage turbine blades, showing good and robust classification performance.


Layer dynamics for the one dimensional varepsilon dependent Cahn Hilliard Allen Cahn equation. We study the dynamics of the one dimensional varepsilon dependent Cahn Hilliard Allen Cahn equation within a neighborhood of an equilibrium of N transition layers, that in general does not conserve mass. Two different settings are considered which differ in that, for the second, we impose a mass conservation constraint in place of one of the zero mass flux boundary conditions at x 1 . Motivated by the study of Carr and Pego on the layered metastable patterns of Allen Cahn in 10 , and by this of Bates and Xun in 5 for the Cahn Hilliard equation, we implement an N dimensional, and a mass conservative N 1 dimensional manifold respectively therein, a metastable state with N transition layers is approximated. We then determine, for both cases, the essential dynamics of the layers (ode systems with the equations of motion), expressed in terms of local coordinates relative to the manifold used. In particular, we estimate the spectrum of the linearized Cahn Hilliard Allen Cahn operator, and specify wide families of varepsilon dependent weights delta( varepsilon) , mu( varepsilon) , acting at each part of the operator, for which the dynamics are stable and rest exponentially small in varepsilon . Our analysis enlightens the role of mass conservation in the classification of the general mixed problem into two main categories where the solution has a profile close to Allen Cahn, or, when the mass is conserved, close to the Cahn Hilliard solution.


Maximum Principle Preserving Finite Difference Scheme for 1 D Nonlocal to Local Diffusion Problems. In a recent paper (see 7 ), a quasi nonlocal coupling method was introduced to seamlessly bridge a nonlocal diffusion model with the classical local diffusion counterpart in a one dimensional space. The proposed coupling framework removes inconsistency on the interface, preserves the balance of fluxes, and satisfies the maximum principle of diffusion problem. However, the numerical scheme proposed in that paper does not maintain all of these properties on a discrete level. In this paper we resolve these issues by proposing a new finite difference scheme that ensures the balance of fluxes and the discrete maximum principle. We rigorously prove these results and provide the stability and convergence analyses accordingly. In addition, we provide the Courant Friedrichs Lewy (CFL) condition for the new scheme and test a series of benchmark examples which confirm the theoretical findings.


Models in the Loop Aiding Crowdworkers with Generative Annotation Assistants. In Dynamic Adversarial Data Collection (DADC), human annotators are tasked with finding examples that models struggle to predict correctly. Models trained on DADC collected training data have been shown to be more robust in adversarial and out of domain settings, and are considerably harder for humans to fool. However, DADC is more time consuming than traditional data collection and thus more costly per example. In this work, we examine if we can maintain the advantages of DADC, without suffering the additional cost. To that end, we introduce Generative Annotation Assistants (GAAs), generator in the loop models that provide real time suggestions that annotators can either approve, modify, or reject entirely. We collect training datasets in twenty experimental settings and perform a detailed analysis of this approach for the task of extractive question answering (QA) for both standard and adversarial data collection. We demonstrate that GAAs provide significant efficiency benefits in terms of annotation speed, while leading to improved model fooling rates. In addition, we show that GAA assisted data leads to higher downstream model performance on a variety of question answering tasks.


Continuous conditional generative adversarial networks for data driven solutions of poroelasticity with heterogeneous material properties. Machine learning based data driven modeling can allow computationally efficient time dependent solutions of PDEs, such as those that describe subsurface multiphysical problems. In this work, our previous approach of conditional generative adversarial networks (cGAN) developed for the solution of steady state problems involving highly heterogeneous material properties is extended to time dependent problems by adopting the concept of continuous cGAN (CcGAN). The CcGAN that can condition continuous variables is developed to incorporate the time domain through either element wise addition or conditional batch normalization. We note that this approach can accommodate other continuous variables (e.g., Young's modulus) similar to the time domain, which makes this framework highly flexible and extendable. Moreover, this framework can handle training data that contain different timestamps and then predict timestamps that do not exist in the training data. As a numerical example, the transient response of the coupled poroelastic process is studied in two different permeability fields Zinn Harvey transformation and a bimodal transformation. The proposed CcGAN uses heterogeneous permeability fields as input parameters while pressure and displacement fields over time are model output. Our results show that the model provides sufficient accuracy with computational speed up. This robust framework will enable us to perform real time reservoir management and robust uncertainty quantification in realistic problems.


Inference and De Noising of Non Gaussian Particle Distribution Functions A Generative Modeling Approach. The particle in cell numerical method of plasma physics balances a trade off between computational cost and intrinsic noise. Inference on data produced by these simulations generally consists of binning the data to recover the particle distribution function, from which physical processes may be investigated. In addition to containing noise, the distribution function is temporally dynamic and can be non gaussian and multi modal, making the task of modeling it difficult. Here we demonstrate the use of normalizing flows to learn a smooth, tractable approximation to the noisy particle distribution function. We demonstrate that the resulting data driven likelihood conserves relevant physics and may be extended to encapsulate the temporal evolution of the distribution function.


Separable Spaces of Continuous Functions as Calkin Algebras. It is proved that for every compact metric space K there exists a Banach space X whose Calkin algebra mathcal L (X) mathcal K (X) is homomorphically isometric to C(K) . This is achieved by appropriately modifying the Bourgain Delbaen mathscr L infty space of Argyros and Haydon in such a manner that sufficiently many diagonal operators on this space are bounded.


HEDP A Method for Early Forecasting Software Defects based on Human Error Mechanisms. As the primary cause of software defects, human error is the key to understanding, and perhaps to predicting and avoiding them. Little research has been done to predict defects on the basis of the cognitive errors that cause them. This paper proposes an approach to predicting software defects through knowledge about the cognitive mechanisms of human errors. Our theory is that the main process behind a software defect is that an error prone scenario triggers human error modes, which psychologists have observed to recur across diverse activities. Software defects can then be predicted by identifying such scenarios, guided by this knowledge of typical error modes. The proposed idea emphasizes predicting the exact location and form of a possible defect. We conducted two case studies to demonstrate and validate this approach, with 55 programmers in a programming competition and 5 analysts serving as the users of the approach. We found it impressive that the approach was able to predict, at the requirement phase, the exact locations and forms of 7 out of the 22 (31.8 ) specific types of defects that were found in the code. The defects predicted tended to be common defects their occurrences constituted 75.7 of the total number of defects in the 55 developed programs each of them was introduced by at least two persons. The fraction of the defects introduced by a programmer that were predicted was on average (over all programmers) 75 . Furthermore, these predicted defects were highly persistent through the debugging process. If the prediction had been used to successfully prevent these defects, this could have saved 46.2 of the debugging iterations. This excellent capability of forecasting the exact locations and forms of possible defects at the early phases of software development recommends the approach for substantial benefits to defect prevention and early detection.


Revisiting the Reduction of Thermal Conductivity in Nano to Micro Grained Bismuth Telluride The Importance of Grain Boundary Thermal Resistance. Nanograined bulk alloys based on bismuth telluride (Bi2Te3) are the dominant materials for room temperature thermoelectric applications. In numerous studies, existing bulk phonon mean free path (MFP) spectra predicted by atomistic simulations suggest sub 100 nm grain sizes are necessary to reduce the lattice thermal conductivity by decreasing phonon MFPs. This is in contrast with available experimental data, where a remarkable thermal conductivity reduction is observed even for micro grained Bi2Te3 samples. In this work, first principles phonon MFPs along both the in plane and cross plane directions are re computed for bulk Bi2Te3. These phonon MFPs can explain new and existing experimental data on flake like Bi2Te3 nanostructures with various thicknesses. For polycrystalline Bi2Te3 based materials, a better explanation of the experimental data requires further consideration of the grain boundary thermal resistance that can largely suppress the transport of high frequency optical phonons.


Counting Subwords in Circular Words and Their Parikh Matrices. The word inference problem is to determine languages such that the information on the number of occurrences of those subwords in the language can uniquely identify a word. A considerable amount of work has been done on this problem, but the same cannot be said for circular words despite growing interests on the latter due to their applications for example, in splicing systems. Meanwhile, Parikh matrices are useful tools and well established in the study of subword occurrences. In this work, we propose two ways of counting subword occurrences in circular words. We then extend the idea of Parikh matrices to the context of circular words and investigate this extension. Motivated by the word inference problem, we study ambiguity in the identification of a circular word by its Parikh matrix. Accordingly, two rewriting rules are developed to generate ternary circular words which share the same Parikh matrix.


Normalized solutions for Schr "odinger equations with critical Sobolev exponent and mixed nonlinearities. In this paper, we consider the following nonlinear Schr " o dinger equations with mixed nonlinearities begin eqnarray left aligned Delta u lambda u mu u q 2 u u 2 2 u quad text in mathbb R N, u in H 1( bbr N), quad int bbr N u 2 a 2, endaligned right. end eqnarray where N geq3 , mu 0 , lambda in mathbb R and 2 q 2 . We prove in this paper begin enumerate item (1) quad Existence of solutions of mountain pass type for N 3 and 2 q 2 frac 4 N . item (2) quad Existence and nonexistence of ground states for 2 frac 4 N leq q 2 with mu 0 large. item (3) quad Precisely asymptotic behaviors of ground states and mountain pass solutions as mu to0 and mu goes to its upper bound. end enumerate Our studies answer some questions proposed by Soave in cite Remarks 1.1, 1.2 and 8.1 S20 .


Dynatomic polynomials, necklace operators, and universal relations for dynamical units. Given a generic polynomial f(x) , the generalized dynatomic polynomial Phi f,c,d (x) vanishes at precisely those alpha such that f c( alpha) has period exactly d under iteration of f(x) . We show that the shifted dynatomic polynomials Phi f,c,d (x) 1 often have generalized dynatomic factors, and that these factors are in correspondence with certain cyclotomic factors of necklace polynomials. These dynatomic factors of Phi f,c,d (x) 1 have an interpretation in terms of new multiplicative relations between dynamical units which are uniform in the polynomial f(x) .


Modular orbits on the representation spaces of compact abelian Lie groups. Let S be a closed surface of genus g greater than zero. In the present paper we study the topological dynamical action of the mapping class group on the Bbb T n character variety giving necessary and sufficient conditions for Mod (S) orbits to be dense. As an application, such a characterisation provides a dynamical proof of the Kronecker's Theorem concerning inhomogeneous diophantine approximation.


Multimodal Dialogue Response Generation. Responsing with image has been recognized as an important capability for an intelligent conversational agent. Yet existing works only focus on exploring the multimodal dialogue models which depend on retrieval based methods, but neglecting generation methods. To fill in the gaps, we first present a multimodal dialogue generation model, which takes the dialogue history as input, then generates a textual sequence or an image as response. Learning such a model often requires multimodal dialogues containing both texts and images which are difficult to obtain. Motivated by the challenge in practice, we consider multimodal dialogue generation under a natural assumption that only limited training examples are available. In such a low resource setting, we devise a novel conversational agent, Divter, in order to isolate parameters that depend on multimodal dialogues from the entire generation model. By this means, the major part of the model can be learned from a large number of text only dialogues and text image pairs respectively, then the whole parameters can be well fitted using the limited training examples. Extensive experiments demonstrate our method achieves state of the art results in both automatic and human evaluation, and can generate informative text and high resolution image responses.


Journalistic Voting System's Effects on Election Security Threats and Gerrymandering. The Journalistic Voting System is a proxy voting system in which journalists are delegated the task of voting on behalf of individual voters in a western style democracy. We introduce the Journalistic Voting System and discuss its potential advantages and potential problems. In particular, we discuss its advantages to individuals in the system (voters, journalists, and politicians) and we discuss its effects relative to several widely discussed threats to election security, namely cybersecurity, social media, big data, artificial intelligence (AI), and gerrymandering. The Journalistic Voting System is modeled on a predecessor system, called the Valence Voting System, which is reviewed.


ApproxIFER A Model Agnostic Approach to Resilient and Robust Prediction Serving Systems. Due to the surge of cloud assisted AI services, the problem of designing resilient prediction serving systems that can effectively cope with stragglers failures and minimize response delays has attracted much interest. The common approach for tackling this problem is replication which assigns the same prediction task to multiple workers. This approach, however, is very inefficient and incurs significant resource overheads. Hence, a learning based approach known as parity model (ParM) has been recently proposed which learns models that can generate parities for a group of predictions in order to reconstruct the predictions of the slow failed workers. While this learning based approach is more resource efficient than replication, it is tailored to the specific model hosted by the cloud and is particularly suitable for a small number of queries (typically less than four) and tolerating very few (mostly one) number of stragglers. Moreover, ParM does not handle Byzantine adversarial workers. We propose a different approach, named Approximate Coded Inference (ApproxIFER), that does not require training of any parity models, hence it is agnostic to the model hosted by the cloud and can be readily applied to different data domains and model architectures. Compared with earlier works, ApproxIFER can handle a general number of stragglers and scales significantly better with the number of queries. Furthermore, ApproxIFER is robust against Byzantine workers. Our extensive experiments on a large number of datasets and model architectures also show significant accuracy improvement by up to 58 over the parity model approaches.


A robust monolithic solver for phase field fracture integrated with fracture energy based arc length method and under relaxation. The phase field fracture free energy functional is non convex with respect to the displacement and the phase field. This results in a poor performance of the conventional monolithic solvers like the Newton Raphson method. In order to circumvent this issue, researchers opt for the alternate minimization (staggered) solvers. Staggered solvers are robust for the phase field based fracture simulations as the displacement and the phase field sub problems are convex in nature. Nevertheless, the staggered solver requires very large number of iterations (of the order of thousands) to converge. In this work, a robust monolithic solver is presented for the phase field fracture problem. The solver adopts a fracture energy based arc length method and an adaptive under relaxation scheme. The arc length method enables the simulation to overcome critical points (snap back, snap through instabilities) during the loading of a specimen. The use of an under relaxation scheme stabilizes the solver by preventing the divergence due to an ill behaving stiffness matrix. The efficiency of the proposed solver is further amplified with an adaptive mesh refinement scheme based on PHT splines within the framework of isogeometric analysis. The numerical examples presented in the manuscript demonstrates the efficacy of the solver. All the codes and data sets accompanying this work will be made available on GitHub (https github.com rbharali IGAFrac).


Assuring Increasingly Autonomous Systems in Human Machine Teams An Urban Air Mobility Case Study. As aircraft systems become increasingly autonomous, the human machine role allocation changes and opportunities for new failure modes arise. This necessitates an approach to identify the safety requirements for the increasingly autonomous system (IAS) as well as a framework and techniques to verify and validate that an IAS meets its safety requirements. We use Crew Resource Management techniques to identify requirements and behaviors for safe human machine teaming behaviors. We provide a methodology to verify that an IAS meets its requirements. We apply the methodology to a case study in Urban Air Mobility, which includes two contingency scenarios unreliable sensor and aborted landing. For this case study, we implement an IAS agent in the Soar language that acts as a copilot for the selected contingency scenarios and performs takeoff and landing preparation, while the pilot maintains final decision authority. We develop a formal human machine team architecture model in the Architectural Analysis and Design Language (AADL), with operator and IAS requirements formalized in the Assume Guarantee REasoning Environment (AGREE) Annex to AADL. We formally verify safety requirements for the human machine team given the requirements on the IAS and operator. We develop an automated translator from Soar to the nuXmv model checking language and formally verify that the IAS agent satisfies its requirements using nuXmv. We share the design and requirements errors found in the process as well as our lessons learned.


First radiative shock experiments on the SG II laser. We report on the design and first results from experiments looking at the formation of radiative shocks on the Shenguang II (SG II) laser at the Shanghai Institute of Optics and Fine Mechanics in China. Laser heating of a two layer CH CH Br foil drives a sim 40 km s shock inside a gas cell filled with argon at an initial pressure of 1 bar. The use of gas cell targets with large (several mm) lateral and axial extent allows the shock to propagate freely without any wall interactions, and permits a large field of view to image single and colliding counter propagating shocks with time resolved, point projection X ray backlighting ( sim20 mu m source size, 4.3 keV photon energy). Single shocks were imaged up to 100 ns after the onset of the laser drive allowing to probe the growth of spatial non uniformities in the shock apex. These results are compared with experiments looking at counter propagating shocks, showing a symmetric drive which leads to a collision and stagnation from sim 40 ns onward. We present a preliminary comparison with numerical simulations with the radiation hydrodynamics code ARWEN, which provides expected plasma parameters for the design of future experiments in this facility.


Special Correspondences of CM Abelian Varieties and Eisenstein Series. Let mathcal CM Phi be the (integral model of the) stack of principally polarized CM Abelian varieties with a CM type Phi . Considering a pair of nearby CM types (i.e. such that they are different in exactly one embedding) Phi 1, Phi 2 , we let X mathcal CM Phi 1 times mathcal CM Phi 2 and define arithmetic divisors mathcal Z ( alpha) on X such that the Arakelov degree of mathcal Z ( alpha) is (up to multiplication by an explicit constant) equal to the central value of the alpha text th coefficient of the Fourier expansion of the derivative of a Hilbert Eisenstein series.


Norms of certain functions of the Laplace operator on the ax b groups. The aim of this paper is to find new estimates for the norms of functions of the (minus) Laplace operator cal L on the ax b ' groups. The central part is devoted to spectrally localized wave propagators, that is, functions of the type psi( sqrt cal L ) exp(it sqrt cal L ) , with psi in C 0( mathbb R ) . We show that for t to infty , the convolution kernel k t of this operator satisfies k t 1 asymp t, qquad k t infty asymp 1, so that the upper estimates of D. M "uller and C. Thiele (Studia Math., 2007) are sharp. As a necessary component, we recall the Plancherel density of cal L and spend certain time presenting and comparing different approaches to its calculation. Using its explicit form, we estimate uniform norms of several functions of the shifted Laplace Beltrami operator tilde Delta , closely related to cal L . The functions include in particular exp( t tilde Delta gamma) , t 0, gamma 0 , and ( tilde Delta z) s , with complex z,s .


Lift theorems for representations of matroids over pastures. Pastures are a class of field like algebraic objects which include both partial fields hyperfields and have nice categorical properties. We prove several lift theorems for representations of matroids over pastures, including a generalization of Pendavingh and van Zwam's Lift Theorem for partial fields. By embedding the earlier theory into a more general framework, we are able to establish new results even in the case of lifts of partial fields, for example the conjecture of Pendavingh van Zwam that their lift construction is idempotent. We give numerous applications to matroid representations, e.g. we show that, up to projective equivalence, every pair consisting of a hexagonal representation and an orientation lifts uniquely to a near regular representation. The proofs are different from the arguments used by Pendavingh and van Zwam, relying instead on a result of Gelfand Rybnikov Stone inspired by Tutte's homotopy theorem.


Trajectory Prediction with Linguistic Representations. Language allows humans to build mental models that interpret what is happening around them resulting in more accurate long term predictions. We present a novel trajectory prediction model that uses linguistic intermediate representations to forecast trajectories, and is trained using trajectory samples with partially annotated captions. The model learns the meaning of each of the words without direct per word supervision. At inference time, it generates a linguistic description of trajectories which captures maneuvers and interactions over an extended time interval. This generated description is used to refine predictions of the trajectories of multiple agents. We train and validate our model on the Argoverse dataset, and demonstrate improved accuracy results in trajectory prediction. In addition, our model is more interpretable it presents part of its reasoning in plain language as captions, which can aid model development and can aid in building confidence in the model before deploying it.


A General Traffic Shaping Protocol in E Commerce. To approach different business objectives, online traffic shaping algorithms aim at improving exposures of a target set of items, such as boosting the growth of new commodities. Generally, these algorithms assume that the utility of each user item pair can be accessed via a well trained conversion rate prediction model. However, for real E Commerce platforms, there are unavoidable factors preventing us from learning such an accurate model. In order to break the heavy dependence on accurate inputs of the utility, we propose a general online traffic shaping protocol for online E Commerce applications. In our framework, we approximate the function mapping the bonus scores, which generally are the only method to influence the ranking result in the traffic shaping problem, to the numbers of exposures and purchases. Concretely, we approximate the above function by a class of the piece wise linear function constructed on the convex hull of the explored data points. Moreover, we reformulate the online traffic shaping problem as linear programming where these piece wise linear functions are embedded into both the objective and constraints. Our algorithm can straightforwardly optimize the linear programming in the prime space, and its solution can be simply applied by a stochastic strategy to fulfill the optimized objective and the constraints in expectation. Finally, the online A B test shows our proposed algorithm steadily outperforms the previous industrial level traffic shaping algorithm.


Investigating the Recoverable Robust Single Machine Scheduling Problem Under Interval Uncertainty. We investigate the recoverable robust single machine scheduling problem under interval uncertainty. In this setting, jobs have first stage processing times p and second stage processing times q and we aim to find a first stage and second stage schedule with a minimum combined sum of completion times, such that at least Delta jobs share the same position in both schedules. We provide positive complexity results for some important special cases of this problem, as well as derive a 2 approximation algorithm to the full problem. Computational experiments examine the performance of an exact mixed integer programming formulation and the approximation algorithm, and demonstrate the strength of a proposed polynomial time greedy heuristic.


A General Method For Automatic Discovery of Powerful Interactions In Click Through Rate Prediction. Modeling powerful interactions is a critical challenge in Click through rate (CTR) prediction, which is one of the most typical machine learning tasks in personalized advertising and recommender systems. Although developing hand crafted interactions is effective for a small number of datasets, it generally requires laborious and tedious architecture engineering for extensive scenarios. In recent years, several neural architecture search (NAS) methods have been proposed for designing interactions automatically. However, existing methods only explore limited types and connections of operators for interaction generation, leading to low generalization ability. To address these problems, we propose a more general automated method for building powerful interactions named AutoPI. The main contributions of this paper are as follows AutoPI adopts a more general search space in which the computational graph is generalized from existing network connections, and the interactive operators in the edges of the graph are extracted from representative hand crafted works. It allows searching for various powerful feature interactions to produce higher AUC and lower Logloss in a wide variety of applications. Besides, AutoPI utilizes a gradient based search strategy for exploration with a significantly low computational cost. Experimentally, we evaluate AutoPI on a diverse suite of benchmark datasets, demonstrating the generalizability and efficiency of AutoPI over hand crafted architectures and state of the art NAS algorithms.


Verifiable and Compositional Reinforcement Learning Systems. We propose a novel framework for verifiable and compositional reinforcement learning (RL) in which a collection of RL sub systems, each of which learns to accomplish a separate sub task, are composed to achieve an overall task. The framework consists of a high level model, represented as a parametric Markov decision process (pMDP) which is used to plan and to analyze compositions of sub systems, and of the collection of low level sub systems themselves. By defining interfaces between the sub systems, the framework enables automatic decompositions of task specifications, e.g., reach a target set of states with a probability of at least 0.95, into individual sub task specifications, i.e. achieve the sub system's exit conditions with at least some minimum probability, given that its entry conditions are met. This in turn allows for the independent training and testing of the sub systems if they each learn a policy satisfying the appropriate sub task specification, then their composition is guaranteed to satisfy the overall task specification. Conversely, if the sub task specifications cannot all be satisfied by the learned policies, we present a method, formulated as the problem of finding an optimal set of parameters in the pMDP, to automatically update the sub task specifications to account for the observed shortcomings. The result is an iterative procedure for defining sub task specifications, and for training the sub systems to meet them. As an additional benefit, this procedure allows for particularly challenging or important components of an overall task to be determined automatically, and focused on, during training. Experimental results demonstrate the presented framework's novel capabilities.


Real time ground filtering algorithm of cloud points acquired using Terrestrial Laser Scanner (TLS). 3D modeling based on point clouds requires ground filtering algorithms that separate ground from non ground objects. This study presents two ground filtering algorithms. The first one is based on normal vectors. It has two variants depending on the procedure to compute the k nearest neighbors. The second algorithm is based on transforming the cloud points into a voxel structure. To evaluate them, the two algorithms are compared according to their execution time, effectiveness and efficiency. Results show that the ground filtering algorithm based on the voxel structure is faster in terms of execution time, effectiveness, and efficiency than the normal vector ground filtering.


A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer. Recurrent neural networks for language models like long short term memory (LSTM) have been utilized as a tool for modeling and predicting long term dynamics of complex stochastic molecular systems. Recently successful examples on learning slow dynamics by LSTM are given with simulation data of low dimensional reaction coordinate. However, in this report we show that the following three key factors significantly affect the performance of language model learning, namely dimensionality of reaction coordinates, temporal resolution and state partition. When applying recurrent neural networks to molecular dynamics simulation trajectories of high dimensionality, we find that rare events corresponding to the slow dynamics might be obscured by other faster dynamics of the system, and cannot be efficiently learned. Under such conditions, we find that coarse graining the conformational space into metastable states and removing recrossing events when estimating transition probabilities between states could greatly help improve the accuracy of slow dynamics learning in molecular dynamics. Moreover, we also explore other models like Transformer, which do not show superior performance than LSTM in overcoming these issues. Therefore, to learn rare events of slow molecular dynamics by LSTM and Transformer, it is critical to choose proper temporal resolution (i.e., saving intervals of MD simulation trajectories) and state partition in high resolution data, since deep neural network models might not automatically disentangle slow dynamics from fast dynamics when both are present in data influencing each other.


Approximation of solutions of DDEs under nonstandard assumptions via Euler scheme. We deal with approximation of solutions of delay differential equations (DDEs) via the classical Euler algorithm. We investigate the pointwise error of the Euler scheme under nonstandard assumptions imposed on the right hand side function f . Namely, we assume that f is globally of at most linear growth, satisfies globally one side Lipschitz condition but it is only locally H "older continuous. We provide a detailed error analysis of the Euler algorithm under such nonstandard regularity conditions. Moreover, we report results of numerical experiments.


Cartesian Fibrations of ( infty,2) categories. In this article we introduce four variance flavours of cartesian 2 fibrations of infty bicategories with infty bicategorical fibres, in the framework of scaled simplicial sets. Given a map p colon mathcal E rightarrow mathcal B of infty bicategories, we define p (co)cartesian arrows and inner outer triangles by means of lifting properties against p . Inner outer (co)cartesian 2 fibrations are then defined to be maps with enough (co)cartesian lifts for arrows and enough inner outer lifts for triangles, together with a compatibility property with respect to whiskerings in the outer case. By doing so, we also recover in particular the case of infty bicategories fibred in infty categories studied in previous work. We also prove that equivalences of such 2 fibrations can be tested fiberwise. As a motivating example, we show that the domain projection mathrm d colon mathrm RMap ( Delta 1, mathcal C ) rightarrow mathcal C is a prototypical example of an outer cartesian 2 fibration, where mathrm RMap (X,Y) denotes the infty bicategory of functors, lax natural transformations and modifications. We then define inner outer (co)cartesian 2 fibrations of categories enriched in infty categories, and we show that a fibration p colon mathcal E rightarrow mathcal B of such categories is a (co)cartesian inner outer 2 fibration if and only if the corresponding mathrm N mathrm sc (p) colon mathrm N mathrm sc mathcal E rightarrow mathrm N mathrm sc mathcal B is a fibration of this type between infty bicategories.


Pants complex, TQFT and hyperbolic geometry. We present a coarse perspective on relations of the SU(2) Witten Reshetikhin Turaev TQFT, the Weil Petersson geometry of the Teichm "uller space, and volumes of hyperbolic 3 manifolds. Using data from the asymptotic expansions of the curve operators in the skein theoretic version of the SU(2) TQFT, as developed by Blanchet, Habegger, Masbaum and Vogel, we define the quantum intersection number between pants decompositions of a closed surface. We show that the quantum intersection number admits two sided bounds in terms of the geometric intersection number and we use it to obtain a metric on the pants graph of surfaces. Using work of Brock we show that the pants graph equipped with this metric is quasi isometric to the Teichm "uller space with the Weil Petersson metric and that the translation length of our metric provides two sided linear bounds on the volume of hyperbolic fibered manifolds. We also obtain a characterization of pseudo Anosov mapping classes in terms of asymptotics of the quantum intersection number under iteration in the mapping class group and relate these asymptotics with stretch factors.


Randomized regularized extended Kaczmarz algorithms for tensor recovery. Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with it consistent linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm (which converges linearly in expectation to the unique minimum norm least squares solution of a linear system) for tensor recovery models with it inconsistent linear measurements. We prove the linear convergence in expectation of our algorithm. Numerical experiments on a tensor least squares problem and a sparse tensor recovery problem are given to illustrate the theoretical results.


Multivariable de Rham representations, Sen theory and p adic differential equations. Let K be a complete valued field extension of mathbf Q p with perfect residue field. We consider p adic representations of a finite product G K, Delta G K Delta of the absolute Galois group G K of K . This product appears as the fundamental group of a product of diamonds. We develop the corresponding p adic Hodge theory by constructing analogues of the classical period rings mathsf B rm dR and mathsf B rm HT , and multivariable Sen theory. In particular, we associate to any p adic representation V of G K, Delta an integrable p adic differential system in several variables mathsf D rm dif (V) . We prove that this system is trivial if and only if the representation V is de Rham. Finally, we relate this differential system to the multivariable overconvergent ( varphi, Gamma) module of V constructed by Pal and Z 'abr 'adi, along classical Berger's construction.


Efficient Micro Structured Weight Unification and Pruning for Neural Network Compression. Compressing Deep Neural Network (DNN) models to alleviate the storage and computation requirements is essential for practical applications, especially for resource limited devices. Although capable of reducing a reasonable amount of model parameters, previous unstructured or structured weight pruning methods can hardly truly accelerate inference, either due to the poor hardware compatibility of the unstructured sparsity or due to the low sparse rate of the structurally pruned network. Aiming at reducing both storage and computation, as well as preserving the original task performance, we propose a generalized weight unification framework at a hardware compatible micro structured level to achieve high amount of compression and acceleration. Weight coefficients of a selected micro structured block are unified to reduce the storage and computation of the block without changing the neuron connections, which turns to a micro structured pruning special case when all unified coefficients are set to zero, where neuron connections (hence storage and computation) are completely removed. In addition, we developed an effective training framework based on the alternating direction method of multipliers (ADMM), which converts our complex constrained optimization into separately solvable subproblems. Through iteratively optimizing the subproblems, the desired micro structure can be ensured with high compression ratio and low performance degradation. We extensively evaluated our method using a variety of benchmark models and datasets for different applications. Experimental results demonstrate state of the art performance.


A DCNN based Arbitrarily Oriented Object Detector for Quality Control and Inspection Application. Following the success of machine vision systems for on line automated quality control and inspection processes, an object recognition solution is presented in this work for two different specific applications, i.e., the detection of quality control items in surgery toolboxes prepared for sterilizing in a hospital, as well as the detection of defects in vessel hulls to prevent potential structural failures. The solution has two stages. First, a feature pyramid architecture based on Single Shot MultiBox Detector (SSD) is used to improve the detection performance, and a statistical analysis based on ground truth is employed to select parameters of a range of default boxes. Second, a lightweight neural network is exploited to achieve oriented detection results using a regression method. The first stage of the proposed method is capable of detecting the small targets considered in the two scenarios. In the second stage, despite the simplicity, it is efficient to detect elongated targets while maintaining high running efficiency.


Shared Control of Robot Robot Collaborative Lifting with Agent Postural and Force Ergonomic Optimization. Humans show specialized strategies for efficient collaboration. Transferring similar strategies to humanoid robots can improve their capability to interact with other agents, leading the way to complex collaborative scenarios with multiple agents acting on a shared environment. In this paper we present a control framework for robot robot collaborative lifting. The proposed shared controller takes into account the joint action of both the robots thanks to a centralized controller that communicates with them, and solves the whole system optimization. Efficient collaboration is ensured by taking into account the ergonomic requirements of the robots through the optimization of posture and contact forces. The framework is validated in an experimental scenario with two iCub humanoid robots performing different payload lifting sequences.


Ray Optical Evaluation of Scattering from Electrically Large Metasurfaces Characterized by Locally Periodic Surface Susceptibilities. This work continues the development of the raytracing method of 1 for computing the scattered fields from metasurfaces characterized by locally periodic reflection and transmission coefficients. In this work, instead of describing the metasurface in terms of scattering coefficients that depend on the incidence direction, its scattering behavior is characterized by the surface susceptibility tensors that appear in the generalized sheet transition conditions (GSTCs). As the latter quantities are constitutive parameters, they do not depend on the incident field and thus enable a more compact and physically motivated description of the surface. The locally periodic susceptibility profile is expanded into a Fourier series, and the GSTCs are rewritten in a form that enables them to be numerically solved for in terms of the reflected and transmitted surface fields. The scattered field at arbitrary detector locations is constructed by evaluating critical point contributions of the first and second kinds using a Forward Ray Tracing (FRT) scheme. The accuracy of the resulting framework has been verified with an Integral Equation based Boundary Element Method (BEM) GSTC full wave solver for a variety of examples such as a periodically modulated metasurface, a metasurface diffuser and a beam collimator.


Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization. Semantic segmentation is one of the basic, yet essential scene understanding tasks for an autonomous agent. The recent developments in supervised machine learning and neural networks have enjoyed great success in enhancing the performance of the state of the art techniques for this task. However, their superior performance is highly reliant on the availability of a large scale annotated dataset. In this paper, we propose a novel fully unsupervised semantic segmentation method, the so called Information Maximization and Adversarial Regularization Segmentation (InMARS). Inspired by human perception which parses a scene into perceptual groups, rather than analyzing each pixel individually, our proposed approach first partitions an input image into meaningful regions (also known as superpixels). Next, it utilizes Mutual Information Maximization followed by an adversarial training strategy to cluster these regions into semantically meaningful classes. To customize an adversarial training scheme for the problem, we incorporate adversarial pixel noise along with spatial perturbations to impose photometrical and geometrical invariance on the deep neural network. Our experiments demonstrate that our method achieves the state of the art performance on two commonly used unsupervised semantic segmentation datasets, COCO Stuff, and Potsdam.


Dynamical invariants and intersection theory on the flex and gothic loci. The flex locus parameterizes plane cubics with three collinear cocritical points under a projection, and the gothic locus arises from quadratic differentials with zeros at a fiber of the projection and with poles at the cocritical points. The flex and gothic loci provide the first example of a primitive, totally geodesic subvariety of moduli space and new rm SL 2( mathbb R ) invariant varieties in Teichm "uller dynamics, as discovered by McMullen Mukamel Wright. In this paper we determine the divisor class of the flex locus as well as various tautological intersection numbers on the gothic locus. For the case of the gothic locus our result confirms numerically a conjecture of Chen M "oller Sauvaget about computing sums of Lyapunov exponents for rm SL 2( mathbb R ) invariant varieties via intersection theory.


Epidemiological theory of virus variants. We propose a physical theory underlying the temporal evolution of competing virus variants that relies on the existence of (quasi) fixed points capturing the large time scale invariance of the dynamics. To motivate our result we first modify the time honoured compartmental models of the SIR type to account for the existence of competing variants and then show how their evolution can be naturally re phrased in terms of flow equations ending at quasi fixed points. As the natural next step we employ (near) scale invariance to organise the time evolution of the competing variants within the effective description of the epidemic Renormalization Group framework. We test the resulting theory against the time evolution of COVID 19 virus variants that validate the theory empirically.


The distribution of spacings of real valued lacunary sequences modulo one. Let left(a n right) n 1 infty be a lacunary sequence of positive real numbers. Rudnick and Technau showed that for almost all alpha in mathbb R , the pair correlation of left( alpha a n right) n 1 infty mod 1 is Poissonian. We show that all higher correlations and hence the nearest neighbour spacing distribution are Poissonian as well, thereby extending a result of Rudnick and Zaharescu to real valued sequences.


Development and analysis of entropy stable no slip wall boundary conditions for the Eulerian model for viscous and heat conducting compressible flows. Nonlinear entropy stability analysis is used to derive entropy stable no slip wall boundary conditions for the Eulerian model proposed by Sv " a rd (Physica A Statistical Mechanics and its Applications, 2018). and its spatial discretization based on entropy stable collocated discontinuous Galerkin operators with the summation by parts property for unstructured grids. A set of viscous test cases of increasing complexity are simulated using both the Eulerian and the classic compressible Navier Stokes models. The numerical results obtained with the two models are compared, and differences and similarities are then highlighted.


Learning Fine Grained Segmentation of 3D Shapes without Part Labels. Learning based 3D shape segmentation is usually formulated as a semantic labeling problem, assuming that all parts of training shapes are annotated with a given set of tags. This assumption, however, is impractical for learning fine grained segmentation. Although most off the shelf CAD models are, by construction, composed of fine grained parts, they usually miss semantic tags and labeling those fine grained parts is extremely tedious. We approach the problem with deep clustering, where the key idea is to learn part priors from a shape dataset with fine grained segmentation but no part labels. Given point sampled 3D shapes, we model the clustering priors of points with a similarity matrix and achieve part segmentation through minimizing a novel low rank loss. To handle highly densely sampled point sets, we adopt a divide and conquer strategy. We partition the large point set into a number of blocks. Each block is segmented using a deep clustering based part prior network trained in a category agnostic manner. We then train a graph convolution network to merge the segments of all blocks to form the final segmentation result. Our method is evaluated with a challenging benchmark of fine grained segmentation, showing state of the art performance.


Differentiating densities on smooth manifolds. Lebesgue integration of derivatives of strongly oscillatory functions is a recurring challenge in computational science and engineering. Integration by parts is an effective remedy for huge computational costs associated with Monte Carlo integration schemes. In case of Lebesgue integrals over a smooth manifold, however, integration by parts gives rise to a derivative of the density implied by charts describing the domain manifold. This paper focuses on the computation of that derivative, which we call the density gradient function, on general smooth manifolds. We analytically derive formulas for the density gradient and present examples of manifolds determined by popular differential equation driven systems. We highlight the significance of the density gradient by demonstrating a numerical example of Monte Carlo integration involving oscillatory integrands.


Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes. Major depressive disorder (MDD) is a prevalent psychiatric disorder that is associated with significant healthcare burden worldwide. Phenotyping of MDD can help early diagnosis and consequently may have significant advantages in patient management. In prior research MDD phenotypes have been extracted from structured Electronic Health Records (EHR) or using Electroencephalographic (EEG) data with traditional machine learning models to predict MDD phenotypes. However, MDD phenotypic information is also documented in free text EHR data, such as clinical notes. While clinical notes may provide more accurate phenotyping information, natural language processing (NLP) algorithms must be developed to abstract such information. Recent advancements in NLP resulted in state of the art neural language models, such as Bidirectional Encoder Representations for Transformers (BERT) model, which is a transformer based model that can be pre trained from a corpus of unsupervised text data and then fine tuned on specific tasks. However, such neural language models have been underutilized in clinical NLP tasks due to the lack of large training datasets. In the literature, researchers have utilized the distant supervision paradigm to train machine learning models on clinical text classification tasks to mitigate the issue of lacking annotated training data. It is still unknown whether the paradigm is effective for neural language models. In this paper, we propose to leverage the neural language models in a distant supervision paradigm to identify MDD phenotypes from clinical notes. The experimental results indicate that our proposed approach is effective in identifying MDD phenotypes and that the Bio Clinical BERT, a specific BERT model for clinical data, achieved the best performance in comparison with conventional machine learning models.


Why it takes a village to manage and share data. Implementation plans for the National Institutes of Health policy for data management and sharing, which takes effect in 2023, provide an opportunity to reflect on the stakeholders, infrastructures, practice, economics, and sustainability of data sharing. Responsibility for fulfilling data sharing requirements tends to fall on principal investigators, whereas it takes a village of stakeholders to construct, manage, and sustain the necessary knowledge infrastructure for disseminating data products. Individual scientists have mixed incentives, and many disincentives to share data, all of which vary by research domain, methods, resources, and other factors. Motivations and investments for data sharing also vary widely among academic institutional stakeholders such as university leadership, research computing, libraries, and individual schools and departments. Stakeholder concerns are interdependent along many dimensions, seven of which are explored what data to share context and credit discovery methods and training intellectual property data science programs and international tensions. Data sharing is not a simple matter of individual practice, but one of infrastructure, institutions, and economics. Governments, funding agencies, and international science organizations all will need to invest in commons approaches for data sharing to develop into a sustainable international ecosystem.


Fast PDE constrained optimization via self supervised operator learning. Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black box) function that associates a performance outcome to a set of controllable variables through an experiment. In cases where the experimental dynamics can be described by partial differential equations (PDEs), such problems can be mathematically translated into PDE constrained optimization tasks, which quickly become intractable as the number of control variables and the cost of experiments increases. In this work we leverage physics informed deep operator networks (DeepONets) a self supervised framework for learning the solution operator of parametric PDEs to build fast and differentiable surrogates for rapidly solving PDE constrained optimization problems, even in the absence of any paired input output training data. The effectiveness of the proposed framework will be demonstrated across different applications involving continuous functions as control or design variables, including time dependent optimal control of heat transfer, and drag minimization of obstacles in Stokes flow. In all cases, we observe that DeepONets can minimize high dimensional cost functionals in a matter of seconds, yielding a significant speed up compared to traditional adjoint PDE solvers that are typically costly and limited to relatively low dimensional control design parametrizations.


A Comprehensive Study on Face Recognition Biases Beyond Demographics. Face recognition (FR) systems have a growing effect on critical decision making processes. Recent works have shown that FR solutions show strong performance differences based on the user's demographics. However, to enable a trustworthy FR technology, it is essential to know the influence of an extended range of facial attributes on FR beyond demographics. Therefore, in this work, we analyse FR bias over a wide range of attributes. We investigate the influence of 47 attributes on the verification performance of two popular FR models. The experiments were performed on the publicly available MAADFace attribute database with over 120M high quality attribute annotations. To prevent misleading statements about biased performances, we introduced control group based validity values to decide if unbalanced test data causes the performance differences. The results demonstrate that also many non demographic attributes strongly affect the recognition performance, such as accessories, hair styles and colors, face shapes, or facial anomalies. The observations of this work show the strong need for further advances in making FR system more robust, explainable, and fair. Moreover, our findings might help to a better understanding of how FR networks work, to enhance the robustness of these networks, and to develop more generalized bias mitigating face recognition solutions.


Question Answering Over Temporal Knowledge Graphs. Temporal Knowledge Graphs (Temporal KGs) extend regular Knowledge Graphs by providing temporal scopes (start and end times) on each edge in the KG. While Question Answering over KG (KGQA) has received some attention from the research community, QA over Temporal KGs (Temporal KGQA) is a relatively unexplored area. Lack of broad coverage datasets has been another factor limiting progress in this area. We address this challenge by presenting CRONQUESTIONS, the largest known Temporal KGQA dataset, clearly stratified into buckets of structural complexity. CRONQUESTIONS expands the only known previous dataset by a factor of 340x. We find that various state of the art KGQA methods fall far short of the desired performance on this new dataset. In response, we also propose CRONKGQA, a transformer based solution that exploits recent advances in Temporal KG embeddings, and achieves performance superior to all baselines, with an increase of 120 in accuracy over the next best performing method. Through extensive experiments, we give detailed insights into the workings of CRONKGQA, as well as situations where significant further improvements appear possible. In addition to the dataset, we have released our code as well.


Holonomy transformations for Lie subalgebroids. Given a foliation, there is a well known notion of holonomy, which can be understood as an action that differentiates to the Bott connection on the normal bundle. We present an analogous notion for Lie subalgebroids, consisting of an effective action of the minimal integration of the Lie subalgebroid, and provide an explicit description in terms of conjugation by bisections. The construction is done in such a way that it easily extends to singular subalgebroids, which provide our main motivation.