Semi implicit Hybrid Discrete left( text H T N right) Approximation of Thermal Radiative Transfer. The thermal radiative transfer (TRT) equations form an integro differential system that describes the propagation and collisional interactions of photons. Computing accurate and efficient numerical solutions TRT are challenging for several reasons, the first of which is that TRT is defined on a high dimensional phase. In order to reduce the dimensionality of the phase space, classical approaches such as the P N (spherical harmonics) or the S N (discrete ordinates) ansatz are often used in the literature. In this work, we introduce a novel approach the hybrid discrete (H T N ) approximation to the radiative thermal transfer equations. This approach acquires desirable properties of both P N and S N , and indeed reduces to each of these approximations in various limits H 1 N equiv P N and H T 0 equiv S T . We prove that H T N results in a system of hyperbolic equations for all T ge 1 and N ge 0 . Another challenge in solving the TRT system is the inherent stiffness due to the large timescale separation between propagation and collisions, especially in the diffusive (i.e., highly collisional) regime. This stiffness challenge can be partially overcome via implicit time integration, although fully implicit methods may become computationally expensive due to the strong nonlinearity and system size. On the other hand, explicit time stepping schemes that are not also asymptotic preserving in the highly collisional limit require resolving the mean free path between collisions, making such schemes prohibitively expensive. In this work we develop a numerical method that is based on a nodal discontinuous Galerkin discretization in space, coupled with a semi implicit discretization in time. We conduct several numerical experiments to verify the accuracy, efficiency, and robustness of the H T N ansatz and the numerical discretizations.


The Deep Minimizing Movement Scheme. Solutions of certain partial differential equations (PDEs) are often represented by the steepest descent curves of corresponding functionals. Minimizing movement scheme was developed in order to study such curves in metric spaces. Especially, Jordan Kinderlehrer Otto studied the Fokker Planck equation in this way with respect to the Wasserstein metric space. In this paper, we propose a deep learning based minimizing movement scheme for approximating the solutions of PDEs. The proposed method is highly scalable for high dimensional problems as it is free of mesh generation. We demonstrate through various kinds of numerical examples that the proposed method accurately approximates the solutions of PDEs by finding the steepest descent direction of a functional even in high dimensions.


The domestic localization of knowledge flows as evidenced by publication citation The case of Italy. This work applies a new approach to measure knowledge flows. Assuming that citation linkages between articles imply a flow of knowledge from the cited to the citing authors, we investigate the geographic flows of scientific knowledge produced in Italy across its regions, at both overall and field level. Furthermore, we measure the the specialization indexes for outflows and inflows of knowledge by a given region. Findings show that larger regions in terms of research output are more likely net exporters of new knowledge. At the same time, we register a positive correlation between the share of intraregional flows and the size of overall scientific output of a region.


Binocular Mutual Learning for Improving Few shot Classification. Most of the few shot learning methods learn to transfer knowledge from datasets with abundant labeled data (i.e., the base set). From the perspective of class space on base set, existing methods either focus on utilizing all classes under a global view by normal pretraining, or pay more attention to adopt an episodic manner to train meta tasks within few classes in a local view. However, the interaction of the two views is rarely explored. As the two views capture complementary information, we naturally think of the compatibility of them for achieving further performance gains. Inspired by the mutual learning paradigm and binocular parallax, we propose a unified framework, namely Binocular Mutual Learning (BML), which achieves the compatibility of the global view and the local view through both intra view and cross view modeling. Concretely, the global view learns in the whole class space to capture rich inter class relationships. Meanwhile, the local view learns in the local class space within each episode, focusing on matching positive pairs correctly. In addition, cross view mutual interaction further promotes the collaborative learning and the implicit exploration of useful knowledge from each other. During meta test, binocular embeddings are aggregated together to support decision making, which greatly improve the accuracy of classification. Extensive experiments conducted on multiple benchmarks including cross domain validation confirm the effectiveness of our method.


A direct relaxation process for particle methods in gas kinetic theory. The multi scale flow mechanism is crucial for force and heat loaded on near space and reentry vehicles, the control of spacecraft by thrusters, the propelling and cooling of MEMS, etc. Since the continuum flow and rarefied flow often exist simultaneously, the modeling and prediction for such a multi scale flow field is very complicated. One important and efficient way of predicting the multi scale flow is constructing numerical methods by adapting the multi scale properties of the temporal integral solutions (or equivalent characteristic line solutions) for the model equations in the gas kinetic theory. The model equations can be classified into FP type and BGK type, and the numerical methods can have deterministic form or stochastic particle form. Since these numerical methods are strictly based on model equations, they are also restricted by the model equations. The difficulty and complexity in constructing model equation that has complete asymptotic preserving property for gas mixture with non equilibrium internal energy will prevent the further extension of these methods. Therefore, this paper addresses the question whether a multi scale numerical method can be established not on the model equations, but directly adapts the relaxation rates of macroscopic variables such as stress and heat flux. Since the algorithm of multi scale particle method based on BGK type equation is clear and simple, its collision step is modified in this work, where the macroscopic variables firstly evolve according to their relaxation rates, and then the molecules that participate in inter molecular collisions get their after collision velocities from the after evolution macroscopic variables. Therefore, this direct relaxation process does not depend on the model equations anymore. Finally, the validity and accuracy of the particle method with direct relaxation process are examined with five test cases.


HYPER 2 Hyperbolic Poincare Embedding for Hyper Relational Link Prediction. Link Prediction, addressing the issue of completing KGs with missing facts, has been broadly studied. However, less light is shed on the ubiquitous hyper relational KGs. Most existing hyper relational KG embedding models still tear an n ary fact into smaller tuples, neglecting the indecomposability of some n ary facts. While other frameworks work for certain arity facts only or ignore the significance of primary triple. In this paper, we represent an n ary fact as a whole, simultaneously keeping the integrity of n ary fact and maintaining the vital role that the primary triple plays. In addition, we generalize hyperbolic Poincar 'e embedding from binary to arbitrary arity data, which has not been studied yet. To tackle the weak expressiveness and high complexity issue, we propose HYPER 2 which is qualified for capturing the interaction between entities within and beyond triple through information aggregation on the tangent space. Extensive experiments demonstrate HYPER 2 achieves superior performance to its translational and deep analogues, improving SOTA by up to 34.5 with relatively few dimensions. Moreover, we study the side effect of literals and we theoretically and experimentally compare the computational complexity of HYPER 2 against several best performing baselines, HYPER 2 is 49 61 times quicker than its counterparts.


Piloting a Game Jam in Nigeria to Support Empathy and Compassion. While games may help to support skills practice and attitudinal change, the game creation process itself may also be effective in enhancing empathy and compassion for other people. Nigeria has over 250 ethnic groups and 500 languages amid its 200 million people. We aim to enhance perspective taking, empathy, and compassion across different ethnic groups using game jams in public schools in Nigeria. In 2021, we piloted a game jam focused on identity exploration and perspective taking for students ages 12 to 20. Initial results and next steps are shared.


Global existence of solutions to Keller Segel chemotaxis system with heterogeneous logistic source and nonlinear secretion. We study the following Keller Segel chemotaxis system with logistic source and nonlinear secretion begin align u t Delta u nabla cdot(u nabla v) kappa( x )u mu( x )u p quad text and quad 0 Delta v v u gamma, end align where kappa( cdot), mu( cdot) 0,R rightarrow 0, infty) , gamma in (1, infty) , p in( gamma 1, infty) and Omega subset mathbb R n, n geq 2 . For this system, we prove the global existence of solutions under suitable assumptions on the initial condition and the functions kappa( cdot) and mu( cdot).


A proof theoretic basis for relational semantics. Logic has proved essential for formally modeling software based systems. Such formal descriptions, frequently called specifications, have served not only as requirements documentation and formalisation, but also for providing the mathematical foundations for their analysis and the development of automated reasoning tools. Logic is usually studied in terms of its two inherent aspects syntax and semantics. The relevance of the latter resides in the fact that producing logical descriptions of real world phenomena, requires people to agree on how such descriptions are to be interpreted and understood by human beings, so that systems can be built with confidence in accordance with their specification. On the more practical side, the metalogical relation between syntax and semantics, determines important aspects of the conclusions one can draw from the application of certain analysis techniques, like model checking. Abstract model theory (i.e., the mathematical perspective on semantics of logical languages) is of little practical value to software engineering endeavours. From our point of view, values (those that can be assigned to constants and variables) should not be just points in a platonic domain of interpretation, but elements that can be named by means of terms over the signature of the specification. In a nutshell, we are not interested in properties that require any semantic information not representable using the available syntax. In this paper we present a framework supporting the proof theoretical formalisation of classes of relational models for behavioural logical languages, whose domains of discourse are guaranteed to be formed exclusively by nameable values.


Umbel convexity and the geometry of trees. For every p in(0, infty) , a new metric invariant called umbel p convexity is introduced. The asymptotic notion of umbel convexity captures the geometry of countably branching trees, much in the same way as Markov convexity, the local invariant which inspired it, captures the geometry of bounded degree trees. Umbel convexity is used to provide a "Poincar 'e type" metric characterization of the class of Banach spaces that admit an equivalent norm with Rolewicz's property ( beta) . We explain how a relaxation of umbel p convexity, called umbel cotype p , plays a role in obtaining compression rate bounds for coarse embeddings of countably branching trees. Local analogs of these invariants, fork q convexity and fork cotype q , are introduced and their relationship to Markov q convexity and relaxations of the q tripod inequality is discussed. The metric invariants are estimated for a large class of Heisenberg groups. Finally, a new characterization of non negative curvature is given.


Blow ups of Lie groupoids and Lie algebroids. In this master's thesis, we will go into the (projective) blow up construction for Lie groupoids and Lie algebroids. In the literature, there are different methods to be found on how to do this, especially for Lie groupoids. The main goal of the thesis is to explain, in detail, the Lie groupoid and the Lie algebroid blow up constructions, but also to examine and compare different points of view. More explicitly, we will rigorously explain the blow up construction for Lie groupoids by Claire Debord and Georges Skandalis. Moreover, we will show that the blow up construction for Lie groupoids by Songhao Li and Marco Gualtieri, and the construction by Kirsten Wang, fit into this setting. Also, we will show that, analogously, we obtain a general geometric blow up construction for Lie algebroids. This construction for Lie algebroids coincides with the construction of lower elementary modification in the codimension one case (by e.g. Songhao Li and Marco Gualtieri, Melinda Lanius, or Ralph Klaasse). Examples that are discussed include the blow up of a pair groupoid (resp. tangent bundle) along a pair groupoid (resp. tangent bundle), the blow up of a groupoid (resp. algebroid) along the groupoid (resp. algebroid) restricted to a saturated submanifold, and the blow up of a regularly foliated manifold along a leaf. The blow up construction by Debord and Skandalis uses the theory of deformation to the normal cones. We will give a broad introduction to this theory and go into some of its known applications. We also discuss the observation made by Debord and Skandalis about Morita invariance of the construction of blow up and of deformation to the normal cone.


Towards high rate RPC based thermal neutron detectors using low resistivity electrodes. We present experimental results on the counting rate measurements for several single gap 10 B lined resistive plate chambers ( 10 B RPCs) with anodes made from standard float glass, low resistivity glass and ceramic. The measurements were performed at the V17 monochromatic neutron beamline (3.35 .A) at the Helmholtz Zentrum Berlin. For the 10 B RPCs with 0.28 mm thick float glass a maximum counting rate density of about 8 times 10 3 Hz cm 2 was obtained. In the case of low resistivity glass and ceramic, the counting rate density did not deviate from linear dependence on the neutron flux up to the maximum flux available at this beamline and exceeded a value of 3 times 10 4 Hz cm 2 .


On statistical inference when fixed points of belief propagation are unstable. Many statistical inference problems correspond to recovering the values of a set of hidden variables from sparse observations on them. For instance, in a planted constraint satisfaction problem such as planted 3 SAT, the clauses are sparse observations from which the hidden assignment is to be recovered. In the problem of community detection in a stochastic block model, the community labels are hidden variables that are to be recovered from the edges of the graph. Inspired by ideas from statistical physics, the presence of a stable fixed point for belief propogation has been widely conjectured to characterize the computational tractability of these problems. For community detection in stochastic block models, many of these predictions have been rigorously confirmed. In this work, we consider a general model of statistical inference problems that includes both community detection in stochastic block models, and all planted constraint satisfaction problems as special cases. We carry out the cavity method calculations from statistical physics to compute the regime of parameters where detection and recovery should be algorithmically tractable. At precisely the predicted tractable regime, we give (i) a general polynomial time algorithm for the problem of detection distinguishing an input with a planted signal from one without (ii) a general polynomial time algorithm for the problem of recovery outputting a vector that correlates with the hidden assignment significantly better than a random guess would.


SynCron Efficient Synchronization Support for Near Data Processing Architectures. Near Data Processing (NDP) architectures present a promising way to alleviate data movement costs and can provide significant performance and energy benefits to parallel applications. Typically, NDP architectures support several NDP units, each including multiple simple cores placed close to memory. To fully leverage the benefits of NDP and achieve high performance for parallel workloads, efficient synchronization among the NDP cores of a system is necessary. However, supporting synchronization in many NDP systems is challenging because they lack shared caches and hardware cache coherence support, which are commonly used for synchronization in multicore systems, and communication across different NDP units can be expensive. This paper comprehensively examines the synchronization problem in NDP systems, and proposes SynCron, an end to end synchronization solution for NDP systems. SynCron adds low cost hardware support near memory for synchronization acceleration, and avoids the need for hardware cache coherence support. SynCron has three components 1) a specialized cache memory structure to avoid memory accesses for synchronization and minimize latency overheads, 2) a hierarchical message passing communication protocol to minimize expensive communication across NDP units of the system, and 3) a hardware only overflow management scheme to avoid performance degradation when hardware resources for synchronization tracking are exceeded. We evaluate SynCron using a variety of parallel workloads, covering various contention scenarios. SynCron improves performance by 1.27 times on average (up to 1.78 times ) under high contention scenarios, and by 1.35 times on average (up to 2.29 times ) under low contention real applications, compared to state of the art approaches. SynCron reduces system energy consumption by 2.08 times on average (up to 4.25 times ).


Ion temperature gradient stability near the magnetic axis of quasisymmetric stellarators. The stability of the ion temperature gradient mode in quasisymmetric stellarators is assessed. This is performed using a set of analytical estimates together with linear gyrokinetic simulations. The peak growth rates, their corresponding real frequencies and wave vectors are identified. A comparison is made between a first order near axis expansion model and eleven realistic designs obtained using numerical optimization methods. It is found that while the near axis expansion is able to replicate the growth rates, real frequencies and perpendicular wave vector at the inner core (both using simplified dispersion relations and first principle gyrokinetic simulations), it leads to an overestimation of the growth rate at larger radii. An approximate analytic solution of the ITG dispersion relation for the non resonant limit suggests growth rates could be systematically higher in quasi axisymmetric (QA) configurations compared to quasi helically (QH) symmetric ones. However except for very close to the axis, linear gyrokinetic simulations do not show systematic differences between QA and QH configurations.


Volume comparison theorem with respect to sigma 2 curvature. In this paper, we consider the volume comparison theorem related to sigma 2 curvature. We proved that if the sigma 2 curvature of sphere is greater than sigma 2 curvature of Einstein manifold with positive Ricci curvature, than we have the volume of sphere is less than the volume of the sphere with standard metrics.


Learning compositional programs with arguments and sampling. One of the most challenging goals in designing intelligent systems is empowering them with the ability to synthesize programs from data. Namely, given specific requirements in the form of input output pairs, the goal is to train a machine learning model to discover a program that satisfies those requirements. A recent class of methods exploits combinatorial search procedures and deep learning to learn compositional programs. However, they usually generate only toy programs using a domain specific language that does not provide any high level feature, such as function arguments, which reduces their applicability in real world settings. We extend upon a state of the art model, AlphaNPI, by learning to generate functions that can accept arguments. This improvement will enable us to move closer to real computer programs. Moreover, we investigate employing an Approximate version of Monte Carlo Tree Search (A MCTS) to speed up convergence. We showcase the potential of our approach by learning the Quicksort algorithm, showing how the ability to deal with arguments is crucial for learning and generalization.


An Experimental Study of Data Heterogeneity in Federated Learning Methods for Medical Imaging. Federated learning enables multiple institutions to collaboratively train machine learning models on their local data in a privacy preserving way. However, its distributed nature often leads to significant heterogeneity in data distributions across institutions. In this paper, we investigate the deleterious impact of a taxonomy of data heterogeneity regimes on federated learning methods, including quantity skew, label distribution skew, and imaging acquisition skew. We show that the performance degrades with the increasing degrees of data heterogeneity. We present several mitigation strategies to overcome performance drops from data heterogeneity, including weighted average for data quantity skew, weighted loss and batch normalization averaging for label distribution skew. The proposed optimizations to federated learning methods improve their capability of handling heterogeneity across institutions, which provides valuable guidance for the deployment of federated learning in real clinical applications.


LEADOR A Method for End to End Participatory Design of Autonomous Social Robots. Participatory Design (PD) in Human Robot Interaction (HRI) typically remains limited to the early phases of development, with subsequent robot behaviours then being hardcoded by engineers or utilised in Wizard of Oz (WoZ) systems that rarely achieve autonomy. We present LEADOR (Led by Experts Automation and Design Of Robots) an end to end PD methodology for domain expert co design, automation and evaluation of social robots. LEADOR starts with typical PD to co design the interaction specifications and state and action space of the robot. It then replaces traditional offline programming or WoZ by an in situ, online teaching phase where the domain expert can live program or teach the robot how to behave while being embedded in the interaction context. We believe that this live teaching can be best achieved by adding a learning component to a WoZ setup, to capture experts' implicit knowledge, as they intuitively respond to the dynamics of the situation. The robot progressively learns an appropriate, expert approved policy, ultimately leading to full autonomy, even in sensitive and or ill defined environments. However, LEADOR is agnostic to the exact technical approach used to facilitate this learning process. The extensive inclusion of the domain expert(s) in robot design represents established responsible innovation practice, lending credibility to the system both during the teaching phase and when operating autonomously. The combination of this expert inclusion with the focus on in situ development also means LEADOR supports a mutual shaping approach to social robotics. We draw on two previously published, foundational works from which this (generalisable) methodology has been derived in order to demonstrate the feasibility and worth of this approach, provide concrete examples in its application and identify limitations and opportunities when applying this framework in new environments.


Bottleneck Convex Subsets Finding k Large Convex Sets in a Point Set. Chv ' a tal and Klincsek (1980) gave an O(n 3) time algorithm for the problem of finding a maximum cardinality convex subset of an arbitrary given set P of n points in the plane. This paper examines a generalization of the problem, the Bottleneck Convex Subsets problem given a set P of n points in the plane and a positive integer k , select k pairwise disjoint convex subsets of P such that the cardinality of the smallest subset is maximized. Equivalently, a solution maximizes the cardinality of k mutually disjoint convex subsets of P of equal cardinality. We show the problem is NP hard when k is an arbitrary input parameter, we give an algorithm that solves the problem exactly, with running time polynomial in n when k is fixed, and we give a fixed parameter tractable algorithm parameterized in terms of the number of points strictly interior to the convex hull.


StablePose Learning 6D Object Poses from Geometrically Stable Patches. We introduce the concept of geometric stability to the problem of 6D object pose estimation and propose to learn pose inference based on geometrically stable patches extracted from observed 3D point clouds. According to the theory of geometric stability analysis, a minimal set of three planar cylindrical patches are geometrically stable and determine the full 6DoFs of the object pose. We train a deep neural network to regress 6D object pose based on geometrically stable patch groups via learning both intra patch geometric features and inter patch contextual features. A subnetwork is jointly trained to predict per patch poses. This auxiliary task is a relaxation of the group pose prediction A single patch cannot determine the full 6DoFs but is able to improve pose accuracy in its corresponding DoFs. Working with patch groups makes our method generalize well for random occlusion and unseen instances. The method is easily amenable to resolve symmetry ambiguities. Our method achieves the state of the art results on public benchmarks compared not only to depth only but also to RGBD methods. It also performs well in category level pose estimation.


WikiChurches A Fine Grained Dataset of Architectural Styles with Real World Challenges. We introduce a novel dataset for architectural style classification, consisting of 9,485 images of church buildings. Both images and style labels were sourced from Wikipedia. The dataset can serve as a benchmark for various research fields, as it combines numerous real world challenges fine grained distinctions between classes based on subtle visual features, a comparatively small sample size, a highly imbalanced class distribution, a high variance of viewpoints, and a hierarchical organization of labels, where only some images are labeled at the most precise level. In addition, we provide 631 bounding box annotations of characteristic visual features for 139 churches from four major categories. These annotations can, for example, be useful for research on fine grained classification, where additional expert knowledge about distinctive object parts is often available. Images and annotations are available at https doi.org 10.5281 zenodo.5166987


Sobolev mappings between nonrigid Carnot groups. We consider mappings between Carnot groups. In this paper, which is a continuation of "Pansu pullback and rigidity of mappings between Carnot groups" (arXiv 2004.09271), we focus on Carnot groups which are nonrigid in the sense of Ottazzi Warhurst. We show that quasisymmetric homeomorphisms are reducible in the sense that they preserve a special type of coset foliation, unless the group is isomorphic to R n or a real or complex Heisenberg group (where the assertion fails). We use this to prove the quasisymmetric rigidity conjecture for such groups. The starting point of the proof is the pullback theorem established our previous paper.


Weighted directed clustering interpretations and requirements for heterogeneous, inferred, and measured networks. Weights and directionality of the edges carry a large part of the information we can extract from a complex network. However, many network measures were formulated initially for undirected binary networks. The necessity to incorporate information about the weights led to the conception of the multiple extensions, particularly for definitions of the local clustering coefficient discussed here. We uncover that not all of these extensions are fully weighted some depend on the degree and thus change a lot when an infinitely small weight edge is exchanged for the absence of an edge, a feature that is not always desirable. We call these methods hybrid'' and argue that, in many situations, one should prefer fully weighted definitions. After listing the necessary requirements for a method to analyze many various weighted networks properly, we propose a fully weighted continuous clustering coefficient that satisfies all the previously proposed criteria while also being continuous with respect to vanishing weights. We demonstrate that the behavior and meaning of the Zhang Horvath clustering and our new continuous definition provide complementary results and significantly outperform other definitions in multiple relevant conditions. Using synthetic and real world examples, we show that when the network is inferred, noisy, or very heterogeneous, it is essential to use the fully weighted clustering definitions.


Rethinking the Image Feature Biases Exhibited by Deep CNN Models. In recent years, convolutional neural networks (CNNs) have been applied successfully in many fields. However, such deep neural models are still regarded as black box in most tasks. One of the fundamental issues underlying this problem is understanding which features are most influential in image recognition tasks and how they are processed by CNNs. It is widely accepted that CNN models combine low level features to form complex shapes until the object can be readily classified, however, several recent studies have argued that texture features are more important than other features. In this paper, we assume that the importance of certain features varies depending on specific tasks, i.e., specific tasks exhibit a feature bias. We designed two classification tasks based on human intuition to train deep neural models to identify anticipated biases. We devised experiments comprising many tasks to test these biases for the ResNet and DenseNet models. From the results, we conclude that (1) the combined effect of certain features is typically far more influential than any single feature (2) in different tasks, neural models can perform different biases, that is, we can design a specific task to make a neural model biased toward a specific anticipated feature.


Blockchain and Federated Edge Learning for Privacy Preserving Mobile Crowdsensing. Mobile crowdsensing (MCS) counting on the mobility of massive workers helps the requestor accomplish various sensing tasks with more flexibility and lower cost. However, for the conventional MCS, the large consumption of communication resources for raw data transmission and high requirements on data storage and computing capability hinder potential requestors with limited resources from using MCS. To facilitate the widespread application of MCS, we propose a novel MCS learning framework leveraging on blockchain technology and the new concept of edge intelligence based on federated learning (FL), which involves four major entities, including requestors, blockchain, edge servers and mobile devices as workers. Even though there exist several studies on blockchain based MCS and blockchain based FL, they cannot solve the essential challenges of MCS with respect to accommodating resource constrained requestors or deal with the privacy concerns brought by the involvement of requestors and workers in the learning process. To fill the gaps, four main procedures, i.e., task publication, data sensing and submission, learning to return final results, and payment settlement and allocation, are designed to address major challenges brought by both internal and external threats, such as malicious edge servers and dishonest requestors. Specifically, a mechanism design based data submission rule is proposed to guarantee the data privacy of mobile devices being truthfully preserved at edge servers consortium blockchain based FL is elaborated to secure the distributed learning process and a cooperation enforcing control strategy is devised to elicit full payment from the requestor. Extensive simulations are carried out to evaluate the performance of our designed schemes.


Fuzzy Classification of Multi intent Utterances. Current intent classification approaches assign binary intent class memberships to natural language utterances while disregarding the inherent vagueness in language and the corresponding vagueness in intent class boundaries. In this work, we propose a scheme to address the ambiguity in single intent as well as multi intent natural language utterances by creating degree memberships over fuzzified intent classes. To our knowledge, this is the first work to address and quantify the impact of the fuzzy nature of natural language utterances over intent category memberships. Additionally, our approach overcomes the sparsity of multi intent utterance data to train classification models by using a small database of single intent utterances to generate class memberships over multi intent utterances. We evaluate our approach over two task oriented dialog datasets, across different fuzzy membership generation techniques and approximate string similarity measures. Our results reveal the impact of lexical overlap between utterances of different intents, and the underlying data distributions, on the fuzzification of intent memberships. Moreover, we evaluate the accuracy of our approach by comparing the defuzzified memberships to their binary counterparts, across different combinations of membership functions and string similarity measures.


Training Feedback Spiking Neural Networks by Implicit Differentiation on the Equilibrium State. Spiking neural networks (SNNs) are brain inspired models that enable energy efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron model. Most existing methods imitate the backpropagation framework and feedforward architectures for artificial neural networks, and use surrogate derivatives or compute gradients with respect to the spiking time to deal with the problem. These approaches either accumulate approximation errors or only propagate information limitedly through existing spikes, and usually require information propagation along time steps with large memory costs and biological implausibility. In this work, we consider feedback spiking neural networks, which are more brain like, and propose a novel training method that does not rely on the exact reverse of the forward computation. First, we show that the average firing rates of SNNs with feedback connections would gradually evolve to an equilibrium state along time, which follows a fixed point equation. Then by viewing the forward computation of feedback SNNs as a black box solver for this equation, and leveraging the implicit differentiation on the equation, we can compute the gradient for parameters without considering the exact forward procedure. In this way, the forward and backward procedures are decoupled and therefore the problem of non differentiable spiking functions is avoided. We also briefly discuss the biological plausibility of implicit differentiation, which only requires computing another equilibrium. Extensive experiments on MNIST, Fashion MNIST, N MNIST, CIFAR 10, and CIFAR 100 demonstrate the superior performance of our method for feedback models with fewer neurons and parameters in a small number of time steps. Our code is avaiable at https github.com pkuxmq IDE FSNN.


An optimal control approach to determine resistance type boundary conditions from in vivo data for cardiovascular simulations. The choice of appropriate boundary conditions is a fundamental step in computational fluid dynamics (CFD) simulations of the cardiovascular system. Boundary conditions, in fact, highly affect the computed pressure and flow rates, and consequently haemodynamic indicators such as wall shear stress, which are of clinical interest. Devising automated procedures for the selection of boundary conditions is vital to achieve repeatable simulations. However, the most common techniques do not automatically assimilate patient specific data, relying instead on expensive and time consuming manual tuning procedures. In this work, we propose a technique for the automated estimation of outlet boundary conditions based on optimal control. The values of resistive boundary conditions are set as control variables and optimized to match available patient specific data. Experimental results on four aortic arches demonstrate that the proposed framework can assimilate 4D Flow MRI data more accurately than two other common techniques based on Murray's law and Ohm's law.


FDH knockout and TsFDH transformation lead to enhanced growth rate of Escherichia coli. Increased Atmospheric CO2 to over 400 ppm has prompted global climate irregularities. Reducing the released CO2 from biotechnological processes could remediate these phenomena. In this study, we sought to find a solution to reduce the amount of CO2 in the process of growth and reproduction by preventing the conversion of formic acid into CO2. The (bio)chemical conversion of formic acid to CO2 is a key reaction. Therefore, we compared the growth of BL21, being a subfamily of K12, alongside two strains in which two different genes related to the formate metabolism were deleted, in complex and simple media. Experimental results were entirely consistent with metabolic predictions. Subsequently, the knockout bacteria grew more efficiently than BL21. Interestingly, TsFDH, a formate dehydrogenase with the tendency of converting CO2 to formate, increased the growth of all strains compared with cells without the TsFDH. Most mutants grew in a simple medium containing glycerol, which showed that glycerol is the preferred carbon source compared to glucose for the growth of E. coli. These results explain the reasons for the inconsistency of predictions in previous metabolic models that declared glycerol as a suitable carbon source for the growth of E. coli but failed to achieve it in practice. To conduct a more mechanistic evaluation of our observations, RNA sequencing data analysis was conducted on an E. coli RNA seq dataset. The gene expression correlation outcome revealed the increased expression levels of several genes related to protein biosynthesis and glycerol degradation as a possible explanation of our observations.


Point BERT Pre training 3D Point Cloud Transformers with Masked Point Modeling. We present Point BERT, a new paradigm for learning Transformers to generalize the concept of BERT to 3D point cloud. Inspired by BERT, we devise a Masked Point Modeling (MPM) task to pre train point cloud Transformers. Specifically, we first divide a point cloud into several local point patches, and a point cloud Tokenizer with a discrete Variational AutoEncoder (dVAE) is designed to generate discrete point tokens containing meaningful local information. Then, we randomly mask out some patches of input point clouds and feed them into the backbone Transformers. The pre training objective is to recover the original point tokens at the masked locations under the supervision of point tokens obtained by the Tokenizer. Extensive experiments demonstrate that the proposed BERT style pre training strategy significantly improves the performance of standard point cloud Transformers. Equipped with our pre training strategy, we show that a pure Transformer architecture attains 93.8 accuracy on ModelNet40 and 83.1 accuracy on the hardest setting of ScanObjectNN, surpassing carefully designed point cloud models with much fewer hand made designs. We also demonstrate that the representations learned by Point BERT transfer well to new tasks and domains, where our models largely advance the state of the art of few shot point cloud classification task. The code and pre trained models are available at https github.com lulutang0608 Point BERT


SIN Superpixel Interpolation Network. Superpixels have been widely used in computer vision tasks due to their representational and computational efficiency. Meanwhile, deep learning and end to end framework have made great progress in various fields including computer vision. However, existing superpixel algorithms cannot be integrated into subsequent tasks in an end to end way. Traditional algorithms and deep learning based algorithms are two main streams in superpixel segmentation. The former is non differentiable and the latter needs a non differentiable post processing step to enforce connectivity, which constraints the integration of superpixels and downstream tasks. In this paper, we propose a deep learning based superpixel segmentation algorithm SIN which can be integrated with downstream tasks in an end to end way. Owing to some downstream tasks such as visual tracking require real time speed, the speed of generating superpixels is also important. To remove the post processing step, our algorithm enforces spatial connectivity from the start. Superpixels are initialized by sampled pixels and other pixels are assigned to superpixels through multiple updating steps. Each step consists of a horizontal and a vertical interpolation, which is the key to enforcing spatial connectivity. Multi layer outputs of a fully convolutional network are utilized to predict association scores for interpolations. Experimental results show that our approach runs at about 80fps and performs favorably against state of the art methods. Furthermore, we design a simple but effective loss function which reduces much training time. The improvements of superpixel based tasks demonstrate the effectiveness of our algorithm. We hope SIN will be integrated into downstream tasks in an end to end way and benefit the superpixel based community. Code is available at href https github.com yuanqqq SIN https github.com yuanqqq SIN .


Spin to Orbital Angular Momentum Conversion via Light Intensity Gradient. Besides a linear momentum, optical fields carry an angular momentum (AM), which have two intrinsic components one is spin angular momentum (SAM) related to the polarization state of the field, and the other is orbital angular momentum (OAM) caused by the helical phase due to the existence of topological azimuthal charge. The two AM components of the optical field may not be independent of each other, and the Spin to Orbital AM conversion (STOC) under focusing will create a spin dependent optical vortex in the longitudinal filed. Here we demonstrate a new mechanism (or novel way, new way, specific process) for the STOC based on a radial intensity gradient. The radial phase provides an effective way to control the local AM density, which induce counterintuitive orbital motion of isotropic particles in optical tweezers without intrinsic OAM. Our work not only provides fundamental insights into the spin orbit interaction of light, but also push towards possible applications in optical micro manipulation.


PixSet An Opportunity for 3D Computer Vision to Go Beyond Point Clouds With a Full Waveform LiDAR Dataset. Leddar PixSet is a new publicly available dataset (dataset.leddartech.com) for autonomous driving research and development. One key novelty of this dataset is the presence of full waveform data from the Leddar Pixell sensor, a solid state flash LiDAR. Full waveform data has been shown to improve the performance of perception algorithms in airborne applications but is yet to be demonstrated for terrestrial applications such as autonomous driving. The PixSet dataset contains approximately 29k frames from 97 sequences recorded in high density urban areas, using a set of various sensors (cameras, LiDARs, radar, IMU, etc.) Each frame has been manually annotated with 3D bounding boxes.


On higher order Fourier analysis in characteristic p . In this paper, the nilspace approach to higher order Fourier analysis is developed in the setting of vector spaces over a prime field mathbb F p , with applications mainly in ergodic theory. A key requisite for this development is to identify a class of nilspaces adequate for this setting. We introduce such a class, whose members we call p homogeneous nilspaces. One of our main results characterizes these objects in terms of a simple algebraic property. We then prove various further results on these nilspaces, leading to a structure theorem describing every finite p homogeneous nilspace as the image, under a nilspace fibration, of a member of a simple family of filtered finite abelian p groups. The applications include a description of the Host Kra factors of ergodic mathbb F p omega systems as p homogeneous nilspace systems. This enables the analysis of these factors to be reduced to the study of such nilspace systems, with central questions on the factors thus becoming purely algebraic problems on finite nilspaces. We illustrate this approach by proving that for k leq p 1 the k th Host Kra factor is an Abramov system of order leq k , extending a result of Bergelson Tao Ziegler that holds for k p . We illustrate the utility of p homogeneous nilspaces also by showing that the above mentioned structure theorem yields a new proof of the Tao Ziegler inverse theorem for Gowers norms on mathbb F p n .


Terahertz birefringent gratings for filtering and dispersion compensation. The recent development of the terahertz waveguide makes it an excellent platform for integrating many intriguing functionalities, which offers tremendous potential to build compact and robust terahertz systems. In the context of next generation high speed communication links at the terahertz band, engineering the dispersion and birefringence of terahertz waves is essential. Here, we experimentally demonstrate subwavelength birefringent waveguide gratings based on the low loss cyclic olefin copolymer exploiting micro machining fabrication techniques. Asymmetric cross section and periodic structural modulation along propagation direction are introduced to achieve birefringent THz grating for filtering and dispersion compensation. Because of strong index modulation in the subwavelength fiber, a high negative group velocity dispersion of 188 ( 88) ps mm THz is achieved at 0.15 THz for x polarization (y polarization), i.e., 7.5 times increase compared to the state of the art reported to date. Such high negative dispersion is realized in a 43 mm grating length, which is less than half of the length reported until now (e.g., 100 mm). Further, the subwavelength fiber grating filters two orthogonal polarization states and exhibits transmission dips with 8.5 dB and 7.5 dB extinction ratios for x and y polarization, respectively. Our experiment demonstrates the feasibility of using polymer based terahertz gratings as a dispersion compensator in terahertz communications and steering polarized terahertz radiations for polarization sensitive THz systems.


User manual for bch, a program for the fast computation of the Baker Campbell Hausdorff and similar series. This manual describes bch, an efficient program written in the C programming language for the fast computation of the Baker Campbell Hausdorff (BCH) and similar Lie series. The Lie series can be represented in the Lyndon basis, in the classical Hall basis, or in the right normed basis of E.S. Chibrikov. In the Lyndon basis, which proves to be particularly efficient for this purpose, the computation of 111013 coefficients for the BCH series up to terms of degree 20 takes less than half a second on an ordinary personal computer and requires negligible 11MB of memory. Up to terms of degree 30, which is the maximum degree the program can handle, the computation of 74248451 coefficients takes 55 hours but still requires only a modest 5.5GB of memory.


Properness of the global to local map for algebraic groups with toric connected component and other finiteness properties. This is a companion paper to our previous work, where we proved the finiteness of the Tate Shafarevich group for an arbitrary torus T over a finitely generated field K with respect to any divisorial set V of places of K . Here, we extend this result to any K group D whose connected component is a torus (for the same V ), and as a consequence obtain a finiteness result for the local to global conjugacy of maximal tori in reductive groups over finitely generated fields. Moreover, we prove the finiteness of the Tate Shafarevich group for tori over function fields K of normal varieties defined over base fields of characteristic zero and satisfying Serre's condition (F), in which case V consists of the discrete valuations associated with the prime divisors on the variety (geometric places). In this situation, we also establish the finiteness of the number of K isomorphism classes of algebraic K tori of a given dimension having good reduction at all v in V , and then discuss ways of extending this result to positive characteristic. Finally, we prove the finiteness of the number of isomorphism classes of forms of an absolutely almost simple group defined over the function field of a complex surface that have good reduction at all geometric places.


A multi linear geometric estimate. We give a generalization of the geometric estimate used by Hart and the second author in their 2008 work on sums and products in finite fields. Their result concerned level sets of non degenerate bilinear forms over finite fields, while in this work we prove that if E subset mathbb F q d is sufficiently large and varpi is a non degenerate multi linear form then varpi will attain all possible nonzero values as its arguments vary over E , under a certain quantitative assumption on the extent to which E is projective. We show that our bound is nontrivial in the case that n 3 and d 2 and construct examples of sets to which this applies. In particular, we give conditions under which every member of mathbb F q belongs to A cdot A cdot A A cdot A cdot A cdot A cdot A cdot A where A is a union of cosets of a subgroup of mathbb F q .


Semi Supervised Domain Generalizable Person Re Identification. Existing person re identification (re id) methods are stuck when deployed to a new unseen scenario despite the success in cross camera person matching. Recent efforts have been substantially devoted to domain adaptive person re id where extensive unlabeled data in the new scenario are utilized in a transductive learning manner. However, for each scenario, it is required to first collect enough data and then train such a domain adaptive re id model, thus restricting their practical application. Instead, we aim to explore multiple labeled datasets to learn generalized domain invariant representations for person re id, which is expected universally effective for each new coming re id scenario. To pursue practicability in real world systems, we collect all the person re id datasets (20 datasets) in this field and select the three most frequently used datasets (i.e., Market1501, DukeMTMC, and MSMT17) as unseen target domains. In addition, we develop DataHunter that collects over 300K weak annotated images named YouTube Human from YouTube street view videos, which joins 17 remaining full labeled datasets to form multiple source domains. On such a large and challenging benchmark called FastHuman ( 440K labeled images), we further propose a simple yet effective Semi Supervised Knowledge Distillation (SSKD) framework. SSKD effectively exploits the weakly annotated data by assigning soft pseudo labels to YouTube Human to improve models' generalization ability. Experiments on several protocols verify the effectiveness of the proposed SSKD framework on domain generalizable person re id, which is even comparable to supervised learning on the target domains. Lastly, but most importantly, we hope the proposed benchmark FastHuman could bring the next development of domain generalizable person re id algorithms.


Maximum first Zagreb index of orientations of unicyclic graphs with given matching number. Let D (V,A) be a digraphs without isolated vertices. The first Zagreb index of a digraph D defined as a summation over all arcs, M 1(D) frac 1 2 sum limits uv in A (d u d v) , where d u (resp. d u ) denotes the out degree (resp. in degree) of the vertex u . In this paper, we give the maximal values and maximal digraphs of first Zagreb index over the set of all orientations of unicyclic graphs with n vertices and matching number m (2 leq m leq lfloor frac n 2 rfloor) .


Dynamic communication topologies for distributed heuristics in energy system optimization algorithms. The communication topology is an essential aspect in designing distributed optimization heuristics. It can influence the exploration and exploitation of the search space and thus the optimization performance in terms of solution quality, convergence speed and collaboration costs, all relevant aspects for applications operating critical infrastructure in energy systems. In this work, we present an approach for adapting the communication topology during runtime, based on the principles of simulated annealing. We compare the approach to common static topologies regarding the performance of an exemplary distributed optimization heuristic. Finally, we investigate the correlations between fitness landscape properties and defined performance metrics.


Conditional Invertible Neural Networks for Diverse Image to Image Translation. We introduce a new architecture called a conditional invertible neural network (cINN), and use it to address the task of diverse image to image translation for natural images. This is not easily possible with existing INN models due to some fundamental limitations. The cINN combines the purely generative INN model with an unconstrained feed forward network, which efficiently preprocesses the conditioning image into maximally informative features. All parameters of a cINN are jointly optimized with a stable, maximum likelihood based training procedure. Even though INN based models have received far less attention in the literature than GANs, they have been shown to have some remarkable properties absent in GANs, e.g. apparent immunity to mode collapse. We find that our cINNs leverage these properties for image to image translation, demonstrated on day to night translation and image colorization. Furthermore, we take advantage of our bidirectional cINN architecture to explore and manipulate emergent properties of the latent space, such as changing the image style in an intuitive way.


Variational p harmonious functions existence and convergence to p harmonic functions. In a recent paper, the last three authors showed that a game theoretic p harmonic function v is characterized by an asymptotic mean value property with respect to a kind of mean value nu p r v (x) defined variationally on balls B r(x) . In this paper, in a domain Om subset RR N , N ge 2 , we consider the operator mu p ve , acting on continuous functions on ol Om , defined by the formula mu p ve v (x) nu r ve(x) p v (x) , where r ve(x) min ve, dist(x, Ga) and Ga denotes the boundary of Omega . We first derive various properties of mu ve p such as continuity and monotonicity. Then, we prove the existence and uniqueness of a function u ve in C( ol Om ) satisfying the Dirichlet type problem u(x) mu p ve u (x) mbox for every x in Om, quad u g mbox on Ga, for any given function g in C( Ga) . This result holds, if we assume the existence of a suitable notion of barrier for all points in Ga . That u ve is what we call the textit variational p harmonious function with Dirichlet boundary data g , and is obtained by means of a Perron type method based on a comparison principle. par We then show that the family u ve ve 0 gives an approximation scheme for the viscosity solution u in C( ol Om ) of De p G u 0 mbox in Om, quad u g mbox on Ga, where De p G is the so called game theoretic (or homogeneous) p Laplace operator. In fact, we prove that u ve converges to u , uniformly on ol Om as ve to 0 .


An Energy Based Discontinuous Galerkin Method with Tame CFL Numbers for the Wave Equation. We extend and analyze the energy based discontinuous Galerkin method for second order wave equations on staggered and structured meshes. By combining spatial staggering with local time stepping near boundaries, the method overcomes the typical numerical stiffness associated with high order piecewise polynomial approximations. In one space dimension with periodic boundary conditions and suitably chosen numerical fluxes, we prove bounds on the spatial operators that establish stability for CFL numbers c frac Delta t h C independent of order when stability enhanced explicit time stepping schemes of matching order are used. For problems on bounded domains and in higher dimensions we demonstrate numerically that one can march explicitly with large time steps at high order temporal and spatial accuracy.


Local Normal Forms of Noncommutative Functions. This article describes local normal forms of functions in noncommuting variables, up to equivalence generated by isomorphism of noncommutative Jacobi algebras, extending singularity theory in the style of Arnold's commutative local normal forms into the noncommutative realm. This generalisation unveils many new phenomena, including an ADE classification when the Jacobi ring has dimension zero and, by suitably taking limits, a further ADE classification in dimension one. These are natural generalisations of the simple singularities and those with infinite multiplicity in Arnold's classification. We obtain normal forms away from some exceptional Type E cases. Remarkably these normal forms have no moduli, and the key new feature is that the noncommutative world affords larger families, and there are many more examples of each type. The first application of noncommutative singularity theory is to the birational geometry of 3 folds. We prove that all local normal forms of Type A and D are geometric, in the sense that each one gives rise to the contraction algebra of some smooth 3 fold flop or divisor to curve contraction. The general elephant of the corresponding contraction has matching type, and so this fully classifies contraction algebras of flops of length one and two. In the process, we describe the first and conjecturally only infinite family of length two crepant divisor to curve contractions. A further consequence is the classification of Gopakumar Vafa invariants for length two flops, with noncommutative obstructions forcing gaps in the invariants that can arise.


A Note on the Interpretation of Distributed Delay Equations. Distributed delay equations have been used to model situations in which there is some sort of delay whose duration is uncertain. However, the interpretation of a distributed delay equation is actually very different from that of a delay differential equation with a random delay. This work explicitly highlights this distinction as it is an important consideration to make when modeling delayed systems in which the delay can take on several values.


An example of a Brauer Manin obstruction to weak approximation at a prime with good reduction. Following Bright and Newton, we construct an explicit K 3 surface over the rational numbers having good reduction at 2, and for which 2 is the only prime at which weak approximation is obstructed.


Choriocapillaris Flow Signal Impairment in Sorsby Fundus Dystrophy. Purpose To quantify choriocapillaris flow alterations in early Sorsby Fundus Dystrophy (SFD) and to investigate the relationship of choriocapillaris flow with the choroidal and outer retinal microstructure. Methods In this prospective case control study, 18 eyes of 11 patients with early SFD and 32 eyes of 32 controls without ocular pathology underwent multimodal imaging including spectral domain optical coherence tomography (OCT)followed by deep learning based layer segmentation. OCT angiography (OCT A) was performed to quantify choriocapillaris flow signal deficits (FDs). Differences in choriocapillaris flow area percentage between SFD patients and controls were determined and a structure function correlation with outer retinal layer thicknesses were analyzed based on mixed model analysis. Results SFD patients exhibited a significantly greater choriocapillaris FDs area percentage than controls (estimate 95 CI 32.05 24.31 39.80 vs. 23.36 20.64 26.09 , P 0.001), even when adjusting for age. Choroidal thickness was a structural OCT surrogate of the choriocapillaris FD area percentage ( 0.82 per 100 micrometer, P 0.017), whereas retinal pigment epithelium drusen complex thickness was not informative regarding choriocapillaris FDs (P 0.932). The choriocapillaris FD area percentage was associated with an altered microstructure of the overlying photoreceptors (outer segments, inner segments and outer nuclear layer thinning of 0.31, 0.12 and 0.47 mu m per FD, respectively, P 0.001). Conclusions Patients with early SFD exhibit pronounced abnormalities of choriocapillaris flow signal on OCT A, which are not limited to areas of sub RPE deposits seen in OCT imaging. Thus, analysis of the choriocapillaris flow may enable clinical trials at earlier disease stages in SFD and possibly in mimicking diseases with an impaired Bruchs membrane including age related macular degeneration.


Kanev and Todorov surfaces in toric 3 folds. In the first part of this article we show for some examples of surfaces of general type in toric 3 folds how to construct minimal and canonical models by toric methods explicitly. The examples we study turn out to be surfaces of general type, namely so called Kanev surfaces and Todorov surfaces. We show how properties of our examples of surfaces could be derived directly from properties of some polytopes and we compute the singularities of their canonical models.


Anomalous Optical Drag. A moving dielectric medium can displace the optical path of light passing through it, a phenomenon known as the Fresnel Fizeau optical drag effect. The resulting displacement is proportional to the medium's velocity. In this article, we report on an anomalous optical drag effect, where the displacement is still proportional to the medium's speed but along the direction opposite to the medium's movement. We conduct an optical drag experiment under conditions of electromagnetically induced transparency and observe the transition from normal, to null, to anomalous optical drag by modification of the two photon detuning.


Ricci de Turck flow on incomplete manifolds. In this paper we construct a Ricci de Turck flow on any incomplete Riemannian manifold with bounded curvature. The central property of the flow is that it stays uniformly equivalent to the initial incomplete Riemannian metric, and in that sense preserves any given initial singularity structure. Together with the corresponding result by Shi for complete manifolds, this gives that any (complete or incomplete) manifold of bounded curvature can be evolved by the Ricci de Turck flow for a short time.


Charge transfer steps in Density Functional Theory from the perspective of the Exact Electron Factorization. When a molecule dissociates, the exact Kohn Sham (KS) and Pauli potentials may form step structures. Reproducing these steps correctly is central for the description of dissociation and charge transfer processes in density functional theory (DFT) The steps align the KS eigenvalues of the dissociating subsystems relative to each other and determine where electrons localize. While the step height can be calculated from the asymptotic behavior of the KS orbitals, this provides limited insight into what causes the steps. We give an explanation of the steps with an exact mapping of the many electron problem to a one electron problem, the exact electron factorizaton (EEF). The potentials appearing in the EEF have a clear physical meaning that translates to the DFT potentials by replacing the interacting many electron system with the KS system. With a simple model of a diatomic, we illustrate that the steps are a consequence of spatial electron entanglement and are the result of a charge transfer. From this mechanism, the step height can immediately be deduced. Moreover, two methods to approximately reproduce the potentials during dissociation suggest themselves. One is based on the states of the dissociated system, while the other one is based on an analogy to the Born Oppenheimer treatment of a molecule. The latter method also shows that the steps connect adiabatic potential energy surfaces. The view of DFT from the EEF thus provides a better understanding of how many electron effects are encoded in a one electron theory and how they can be modeled.


Bag of Tasks Scheduling on Related Machines. We consider online scheduling to minimize weighted completion time on related machines, where each job consists of several tasks that can be concurrently executed. A job gets completed when all its component tasks finish. We obtain an O(K 3 log 2 K) competitive algorithm in the non clairvoyant setting, where K denotes the number of distinct machine speeds. The analysis is based on dual fitting on a precedence constrained LP relaxation that may be of independent interest.


Understanding and Achieving Efficient Robustness with Adversarial Supervised Contrastive Learning. Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the model the opportunity to contrast' between data and class representation in the latent space. In this paper, we investigate CL for improving model robustness using adversarial samples. We first designed and performed a comprehensive study to understand how adversarial vulnerability behaves in the latent space. Based on this empirical evidence, we propose an effective and efficient supervised contrastive learning to achieve model robustness against adversarial attacks. Moreover, we propose a new sample selection strategy that optimizes the positive negative sets by removing redundancy and improving correlation with the anchor. Extensive experiments show that our Adversarial Supervised Contrastive Learning (ASCL) approach achieves comparable performance with the state of the art defenses while significantly outperforms other CL based defense methods by using only 42.8 positives and 6.3 negatives.


An Automatic System to Monitor the Physical Distance and Face Mask Wearing of Construction Workers in COVID 19 Pandemic. The COVID 19 pandemic has caused many shutdowns in different industries around the world. Sectors such as infrastructure construction and maintenance projects have not been suspended due to their significant effect on people's routine life. In such projects, workers work close together that makes a high risk of infection. The World Health Organization recommends wearing a face mask and practicing physical distancing to mitigate the virus's spread. This paper developed a computer vision system to automatically detect the violation of face mask wearing and physical distancing among construction workers to assure their safety on infrastructure projects during the pandemic. For the face mask detection, the paper collected and annotated 1,000 images, including different types of face mask wearing, and added them to a pre existing face mask dataset to develop a dataset of 1,853 images. Then trained and tested multiple Tensorflow state of the art object detection models on the face mask dataset and chose the Faster R CNN Inception ResNet V2 network that yielded the accuracy of 99.8 . For physical distance detection, the paper employed the Faster R CNN Inception V2 to detect people. A transformation matrix was used to eliminate the camera angle's effect on the object distances on the image. The Euclidian distance used the pixels of the transformed image to compute the actual distance between people. A threshold of six feet was considered to capture physical distance violation. The paper also used transfer learning for training the model. The final model was applied on four videos of road maintenance projects in Houston, TX, that effectively detected the face mask and physical distance. We recommend that construction owners use the proposed system to enhance construction workers' safety in the pandemic situation.


Tell Tale Tail Latencies Pitfalls and Perils in Database Benchmarking. The performance of database systems is usually characterised by their average case (i.e., throughput) behaviour in standardised or de facto standard benchmarks like TPC X or YCSB. While tails of the latency (i.e., response time) distribution receive considerably less attention, they have been identified as a threat to the overall system performance In large scale systems, even a fraction of requests delayed can build up into delays perceivable by end users. To eradicate large tail latencies from database systems, the ability to faithfully record them, and likewise pinpoint them to the root causes, is imminently required. In this paper, we address the challenge of measuring tail latencies using standard benchmarks, and identify subtle perils and pitfalls. In particular, we demonstrate how Java based benchmarking approaches can substantially distort tail latency observations, and discuss how the discovery of such problems is inhibited by the common focus on throughput performance. We make a case for purposefully re designing database benchmarking harnesses based on these observations to arrive at faithful characterisations of database performance from multiple important angles.


Optimal Reservoir Operations using Long Short Term Memory Network. A reliable forecast of inflows to the reservoir is a key factor in the optimal operation of reservoirs. Real time operation of the reservoir based on forecasts of inflows can lead to substantial economic gains. However, the forecast of inflow is an intricate task as it has to incorporate the impacts of climate and hydrological changes. Therefore, the major objective of the present work is to develop a novel approach based on long short term memory (LSTM) for the forecast of inflows. Real time inflow forecast, in other words, daily inflow at the reservoir helps in efficient operation of water resources. Also, daily variations in the release can be monitored efficiently and the reliability of operation is improved. This work proposes a naive anomaly detection algorithm baseline based on LSTM. In other words, a strong baseline to forecast flood and drought for any deep learning based prediction model. The practicality of the approach has been demonstrated using the observed daily data of the past 20 years from Bhakra Dam in India. The results of the simulations conducted herein clearly indicate the supremacy of the LSTM approach over the traditional methods of forecasting. Although, experiments are run on data from Bhakra Dam Reservoir in India, LSTM model, and anomaly detection algorithm are general purpose and can be applied to any basin with minimal changes. A distinct practical advantage of the LSTM method presented herein is that it can adequately simulate non stationarity and non linearity in the historical data.


D Cliques Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning. The convergence speed of machine learning models trained with Federated Learning is significantly affected by heterogeneous data partitions, even more so in a fully decentralized setting without a central server. In this paper, we show that the impact of label distribution skew, an important type of data heterogeneity, can be significantly reduced by carefully designing the underlying communication topology. We present D Cliques, a novel topology that reduces gradient bias by grouping nodes in sparsely interconnected cliques such that the label distribution in a clique is representative of the global label distribution. We also show how to adapt the updates of decentralized SGD to obtain unbiased gradients and implement an effective momentum with D Cliques. Our extensive empirical evaluation on MNIST and CIFAR10 demonstrates that our approach provides similar convergence speed as a fully connected topology, which provides the best convergence in a data heterogeneous setting, with a significant reduction in the number of edges and messages. In a 1000 node topology, D Cliques require 98 less edges and 96 less total messages, with further possible gains using a small world topology across cliques.


Dynamics of Equity, Efficiency, and Efficacy in Home Health Care with Patient and Caregiver Preferences. There are three main entities in an HHC setting the firm, the caregivers, and the patients. Often times the interests of each group of entities conflict with the other two. Whether a non profit or a for profit HHC, the firm generally seeks efficiency in terms of maximum utilization of the resources and highest level of care provided to the patients. Caregivers, seek a fair utilization across the network in order to increase job satisfaction. Finally, the patients seek maximum satisfaction level and a fair share of the care provided by the firm. Therefore, looking at HHCs from either one of these lenses by themselves leads to decisions that may neglect the interests of the others. The goal of this paper is to integrate the objectives of these three groups into one place and study their dynamics.


A Lower Bound Estimate of Life Span of Solutions to Stochastic 3D Navier Stokes Equations with Convolution Type Noise. In this paper we investigate the stochastic 3D Navier Stokes equations perturbed by linear multiplicative Gaussian noise of convolution type by transformation to random PDEs. We are not interested in the regularity of the initial data. We focus on obtaining bounds from below for the life span associated with regular initial data. The key point of the proof is the fixed point argument.


Multi objective simulation optimization of the adhesive bonding process of materials. Automotive companies are increasingly looking for ways to make their products lighter, using novel materials and novel bonding processes to join these materials together. Finding the optimal process parameters for such adhesive bonding process is challenging. In this research, we successfully applied Bayesian optimization using Gaussian Process Regression and Logistic Regression, to efficiently (i.e., requiring few experiments) guide the design of experiments to the Pareto optimal process parameter settings.


Conditionally Parameterized, Discretization Aware Neural Networks for Mesh Based Modeling of Physical Systems. Simulations of complex physical systems are typically realized by discretizing partial differential equations (PDEs) on unstructured meshes. While neural networks have recently been explored for surrogate and reduced order modeling of PDE solutions, they often ignore interactions or hierarchical relations between input features, and process them as concatenated mixtures. We generalize the idea of conditional parameterization using trainable functions of input parameters to generate the weights of a neural network, and extend them in a flexible way to encode critical information. Inspired by discretized numerical methods, choices of the parameters include physical quantities and mesh topology features. The functional relation between the modeled features and the parameters is built into the network architecture. The method is implemented on different networks and applied to frontier scientific machine learning tasks including the discovery of unmodeled physics, super resolution of coarse fields, and the simulation of unsteady flows with chemical reactions. The results show that the conditionally parameterized networks provide superior performance compared to their traditional counterparts. The CP GNet an architecture that can be trained on very few data snapshots is proposed as the first deep learning model capable of standalone prediction of reacting flows on irregular meshes.


Classes of cut ideals and their Betti numbers. We study monomial cut ideals associated to a graph G , which are a monomial analogue of toric cut ideals as introduced by Sturmfels and Sullivant. Primary decompositions, projective dimensions, and Castelnuovo Mumford regularities are investigated if the graph can be decomposed as 0 clique sums and disjoint union of subgraphs. The total Betti numbers of a cycle are computed. Moreover, we classify all Freiman ideals among monomial cut ideals.


Trace formula for contractions and it's representation in mathbb D . The aim of this article is twofold give a short proof of the existence of real spectral shift function and the associated trace formula for a pair of contractions, the difference of which is trace class and one of the two a strict contraction, so that the set of assumptions is minimal in comparison to those in all the existing proofs. The second one is to find a trace formula for differences of functions of contraction and its adjoint, in which case, the integral in the formula is over the unit disc and has an expression surprisingly similar to the Helton Howe formula.


Chow rings of low degree Hurwitz spaces. While there is much work and many conjectures surrounding the intersection theory of the moduli space of curves, relatively little is known about the intersection theory of the Hurwitz space mathcal H k, g parametrizing smooth degree k , genus g covers of mathbb P 1 . Let k 3, 4, 5 . We prove that the rational Chow rings of mathcal H k,g stabilize in a suitable sense as g tends to infinity. In the case k 3 , we completely determine the Chow rings for all g . We also prove that the rational Chow groups of the simply branched Hurwitz space mathcal H s k,g subset mathcal H k,g are zero in codimension up to roughly g k . In subsequent work, results developed in this paper are used to prove that the Chow rings of mathcal M 7, mathcal M 8, and mathcal M 9 are tautological.


Everyday algorithm auditing Understanding the power of everyday users in surfacing harmful algorithmic behaviors. A growing body of literature has proposed formal approaches to audit algorithmic systems for biased and harmful behaviors. While formal auditing approaches have been greatly impactful, they often suffer major blindspots, with critical issues surfacing only in the context of everyday use once systems are deployed. Recent years have seen many cases in which everyday users of algorithmic systems detect and raise awareness about harmful behaviors that they encounter in the course of their everyday interactions with these systems. However, to date little academic attention has been granted to these bottom up, user driven auditing processes. In this paper, we propose and explore the concept of everyday algorithm auditing, a process in which users detect, understand, and interrogate problematic machine behaviors via their day to day interactions with algorithmic systems. We argue that everyday users are powerful in surfacing problematic machine behaviors that may elude detection via more centrally organized forms of auditing, regardless of users' knowledge about the underlying algorithms. We analyze several real world cases of everyday algorithm auditing, drawing lessons from these cases for the design of future platforms and tools that facilitate such auditing behaviors. Finally, we discuss work that lies ahead, toward bridging the gaps between formal auditing approaches and the organic auditing behaviors that emerge in everyday use of algorithmic systems.


Congruence simplicity of Steinberg algebras of non Hausdorff ample groupoids over semifields. We investigate the algebra of an ample groupoid, introduced by Steinberg, over a semifield S. In particular, we obtain a complete characterization of congruence simpleness for Steinberg algebras of second countable ample groupoids, extending the well known characterizations when S is a field. We apply our congruence simplicity results to tight groupoids of inverse semigroup representations associated to self similar graphs.


CNN Model Tuning for Global Road Damage Detection. This paper provides a report on our solution including model selection, tuning strategy and results obtained for Global Road Damage Detection Challenge. This Big Data Cup Challenge was held as a part of IEEE International Conference on Big Data 2020. We assess single and multi stage network architectures for object detection and provide a benchmark using popular state of the art open source PyTorch frameworks like Detectron2 and Yolov5. Data preparation for provided Road Damage training dataset, captured using smartphone camera from Czech, India and Japan is discussed. We studied the effect of training on a per country basis with respect to a single generalizable model. We briefly describe the tuning strategy for the experiments conducted on two stage Faster R CNN with Deep Residual Network (Resnet) and Feature Pyramid Network (FPN) backbone. Additionally, we compare this to a one stage Yolov5 model with Cross Stage Partial Network (CSPNet) backbone. We show a mean F1 score of 0.542 on Test2 and 0.536 on Test1 datasets using a multi stage Faster R CNN model, with Resnet 50 and Resnet 101 backbones respectively. This shows the generalizability of the Resnet 50 model when compared to its more complex counterparts. Experiments were conducted using Google Colab having K80 and a Linux PC with 1080Ti, NVIDIA consumer grade GPU. A PyTorch based Detectron2 code to preprocess, train, test and submit the Avg F1 score to is made available at https github.com vishwakarmarhl rdd2020


Intermittent symmetry breaking and stability of the sharp Agmon H "ormander estimate on the sphere. We compute the optimal constant and characterise the maximisers at all spatial scales for the Agmon H "ormander L 2 Fourier adjoint restriction estimate on the sphere. The maximisers switch back and forth from being constants to being non symmetric at the zeros of two Bessel functions. We also study the stability of this estimate and establish a sharpened version in the spirit of Bianchi Egnell. The corresponding stability constant and maximisers again exhibit a curious intermittent behaviour.


A Recipe for Social Media Analysis. The Ubiquitous nature of smartphones has significantly increased the use of social media platforms, such as Facebook, Twitter, TikTok, and LinkedIn, etc., among the public, government, and businesses. Facebook generated 70 billion USD in 2019 in advertisement revenues alone, a 27 increase from the previous year. Social media has also played a strong role in outbreaks of social protests responsible for political changes in different countries. As we can see from the above examples, social media plays a big role in business intelligence and international politics. In this paper, we present and discuss a high level functional intelligence model (recipe) of Social Media Analysis (SMA). This model synthesizes the input data and uses operational intelligence to provide actionable recommendations. In addition, it also matches the synthesized function of the experiences and learning gained from the environment. The SMA model presented is independent of the application domain, and can be applied to different domains, such as Education, Healthcare and Government, etc. Finally, we also present some of the challenges faced by SMA and how the SMA model presented in this paper solves them.


A review of mobile robot motion planning methods from classical motion planning workflows to reinforcement learning based architectures. Motion planning is critical to realize the autonomous operation of mobile robots. As the complexity and randomness of robot application scenarios increase, the planning capability of the classical hierarchical motion planners is challenged. With the development of machine learning, deep reinforcement learning (DRL) based motion planner has gradually become a research hotspot due to its several advantageous features. DRL based motion planner is model free and does not rely on the prior structured map. Most importantly, DRL based motion planner achieves the unification of the global planner and the local planner. In this paper, we provide a systematic review of various motion planning methods. First, we summarize the representative and state of the art works for each submodule of the classical motion planning architecture and analyze their performance features. Subsequently, we concentrate on summarizing RL based motion planning approaches, including motion planners combined with RL improvements, map free RL based motion planners, and multi robot cooperative planning methods. Last but not least, we analyze the urgent challenges faced by these mainstream RL based motion planners in detail, review some state of the art works for these issues, and propose suggestions for future research.


The analysis approach of ThreatGet. Nowadays, almost all electronic devices include a communication interface that allows to interact with them, exchange data, or operate their services remotely. The trend toward increased interconnectivity simultaneously increases the vulnerability of these systems. Due to the high costs associated with comprehensive security analysis, many manufacturers neglect the safety aspect of a product in order to avoid costs. However, the importance of secure IT systems is growing, as the security of a system can also influence safety critical aspects. Standard security analysis approaches are nowadays still mainly based on time intensive and error prone manual activities. In this paper, we present the formal concepts of the automatic threat and vulnerability analysis tool ThreatGet. Therefore, we introduce the concept of the Extended Data Flow Diagram that is used to represent the system under investigation in an abstracted form, and we highlight the formal analysis language of the tool. This domain specific language is used to formulate so called anti patterns. These anti patterns that can be interpreted by the tool for an automatic security analysis of the system. Besides the language declaration, we present the entire semantic evaluation of the language during the analysis. Parts of the definitions and elaborations of the diagram model and the analysis language were developed in the context of the master thesis of Korbinian Christl, in cooperation with the University of Vienna.


Extendable periodic automorphisms of closed surfaces over the 3 sphere. A periodic automorphism of a surface Sigma is said to be extendable over S 3 if it extends to a periodic automorphism of the pair (S 3, Sigma) for some possible embedding Sigma to S 3 . We classify and construct all extendable automorphisms of closed surfaces, with orientation reversing cases included. Moreover, they can all be induced by automorphisms of S 3 on Heegaard surfaces. As a by product, the embeddings of surfaces into lens spaces are discussed.


On anticommutative algebras for which R a,R b is a derivation. We study anticommutative algebras with the property that commutator of any two multiplications is a derivation.


New estimates on the size of ( alpha,2 alpha) Furstenberg sets. We use recent advances on the discretized sum product problem to obtain new bounds on the Hausdorff dimension of planar ( alpha,2 alpha) Fursterberg sets. This provides a quantitative improvement to the 2 alpha epsilon bound of H 'era Shmerkin Yavicoli. In particular, we show that every 1 2 Furstenberg set has dimension at least 1 1 4536 .


Automated Synthesis of Steady State Continuous Processes using Reinforcement Learning. Automated flowsheet synthesis is an important field in computer aided process engineering. The present work demonstrates how reinforcement learning can be used for automated flowsheet synthesis without any heuristics of prior knowledge of conceptual design. The environment consists of a steady state flowsheet simulator that contains all physical knowledge. An agent is trained to take discrete actions and sequentially built up flowsheets that solve a given process problem. A novel method named SynGameZero is developed to ensure good exploration schemes in the complex problem. Therein, flowsheet synthesis is modelled as a game of two competing players. The agent plays this game against itself during training and consists of an artificial neural network and a tree search for forward planning. The method is applied successfully to a reaction distillation process in a quaternary system.


Simple Questions Generate Named Entity Recognition Datasets. Named entity recognition (NER) is a task of extracting named entities of specific types from text. Current NER models often rely on human annotated datasets requiring the vast engagement of professional knowledge on the target domain and entities. This work introduces an ask to generate approach, which automatically generates NER datasets by asking simple natural language questions that reflect the needs for entity types (e.g., Which disease?) to an open domain question answering system. Without using any in domain resources (i.e., training sentences, labels, or in domain dictionaries), our models solely trained on our generated datasets largely outperform previous weakly supervised models on six NER benchmarks across four different domains. Surprisingly, on NCBI disease, our model achieves 75.5 F1 score and even outperforms the previous best weakly supervised model by 4.1 F1 score, which utilizes a rich in domain dictionary provided by domain experts. Formulating the needs of NER with natural language also allows us to build NER models for fine grained entity types such as Award, where our model even outperforms fully supervised models. On three few shot NER benchmarks, our model achieves new state of the art performance.


Moments of central values of quartic Dirichlet L functions. In this paper, we study moments of the central values of quartic Dirichlet L functions and establish quantitative non vanishing result for these L values.


Map completion from partial observation using the global structure of multiple environmental maps. Using the spatial structure of various indoor environments as prior knowledge, the robot would construct the map more efficiently. Autonomous mobile robots generally apply simultaneous localization and mapping (SLAM) methods to understand the reachable area in newly visited environments. However, conventional mapping approaches are limited by only considering sensor observation and control signals to estimate the current environment map. This paper proposes a novel SLAM method, map completion network based SLAM (MCN SLAM), based on a probabilistic generative model incorporating deep neural networks for map completion. These map completion networks are primarily trained in the framework of generative adversarial networks (GANs) to extract the global structure of large amounts of existing map data. We show in experiments that the proposed method can estimate the environment map 1.3 times better than the previous SLAM methods in the situation of partial observation.


Relative Binding Free Energy Calculations for Ligands with Diverse Scaffolds with the Alchemical Transfer Method. We present an extension of Alchemical Transfer Method (ATM) for the estimation of relative binding free energies of molecular complexes applicable to conventional as well as scaffold hopping alchemical transformations. The method, named ATM RBFE, implemented in the free and open source OpenMM molecular simulation package, aims to provide a simpler and more generally applicable route to the calculation of relative binding free energies than is currently available. The method is based on sound statistical mechanics theory and a novel coordinate perturbation scheme designed to swap the positions of a pair of ligands such that one is transferred from the bulk solvent to the receptor binding site while the other moves simultaneously in the opposite direction. The calculation is conducted directly using a single solvent box prepared using conventional setup tools, without splitting of electrostatic and non electrostatic transformations, and without pairwise soft core potentials. ATM RBFE is validated here against the absolute binding free energies of the SAMPL8 GDCC host guest benchmark set and against a benchmark set of estrogen receptor alpha complexes. In each case, the method yields self consistent and converged relative binding free energy estimates in agreement with absolute binding free energies, reference literature values as well as experimental measurements.


Joint Learning of Visual Audio Saliency Prediction and Sound Source Localization on Multi face Videos. Visual and audio events simultaneously occur and both attract attention. However, most existing saliency prediction works ignore the influence of audio and only consider vision modality. In this paper, we propose a multitask learning method for visual audio saliency prediction and sound source localization on multi face video by leveraging visual, audio and face information. Specifically, we first introduce a large scale database of multi face video in visual audio condition (MVVA), containing eye tracking data and sound source annotations. Using this database, we find that sound influences human attention, and conversly attention offers a cue to determine sound source on multi face video. Guided by these findings, a visual audio multi task network (VAM Net) is introduced to predict saliency and locate sound source. VAM Net consists of three branches corresponding to visual, audio and face modalities. Visual branch has a two stream architecture to capture spatial and temporal information. Face and audio branches encode audio signals and faces, respectively. Finally, a spatio temporal multi modal graph (STMG) is constructed to model the interaction among multiple faces. With joint optimization of these branches, the intrinsic correlation of the tasks of saliency prediction and sound source localization is utilized and their performance is boosted by each other. Experiments show that the proposed method outperforms 12 state of the art saliency prediction methods, and achieves competitive results in sound source localization.


An outer totalistic weakly universal cellular automaton in the dodecagrid with four states. In this paper, we prove that there is an outer totalistic weakly universal cellular automaton in the dodecagrid, the tessellation 5,3,4 of the hyperbolic 3D space, with four states. It is the first result in such a context.


Laplacian Coefficients of a Forest in terms of the Number of Closed Walks in the Forest and its Line Graph. Let G be a finite simple graph with Laplacian polynomial psi(G, lambda) sum k 0 n( 1) n k c k lambda k . In an earlier paper, the coefficients c n 4 and c n 5 for tree with respect to some degree based graph invariants were computed. The aim of this paper is to continue this work by giving an exact formula for the coefficients c n 6 . As a consequence of this work, the Laplacian coefficients c n k of a forest F , 1 leq k leq 6 , are computed in terms of the number of closed walks in F and its line graph.


Generalizations of the Hilbert Weierstrass Theorem and Tonelli Morrey Theorem the Regularity of Solutions of Differential Equations and Optimal Control Problems. Two Theorems attributed to Hilbert Weierstrass and Tonelli Morrey respectively are two classical studies for the regularity discussion around the solutions of some problems in the realm of Calculus of Variations. Now, since differential equations and optimal control problems with high order have been growing in the literature, addressing the regularity issues for these problems should be paid more attention. In this regard, here, a generalization for the regularity theorems will be presented. It is desired that these theorems will be useful for researchers to prove the regularity properties of differential equations or optimal control problems.


An enhanced VEM formulation for plane elasticity. In this paper, an enhanced Virtual Element Method (VEM) formulation is proposed for plane elasticity. It is based on the improvement of the strain representation within the element, without altering the degree of the displacement interpolating functions on the element boundary. The idea is to fully exploit polygonal elements with a high number of sides, a peculiar VEM feature, characterized by many displacement degrees of freedom on the element boundary, even if a low interpolation order is assumed over each side. The proposed approach is framed within a generalization of the classic VEM formulation, obtained by introducing an energy norm in the projection operator definition. Although such generalization may mainly appear to have a formal value, it allows to effectively point out the mechanical meaning of the quantities involved in the projection operator definition and to drive the selection of the enhanced representations. Various enhancements are proposed and tested through several numerical examples. Numerical results successfully show the capability of the enhanced VEM formulation to (i) considerably increase accuracy (with respect to standard VEM) while keeping the optimal convergence rate, (ii) bypass the need of stabilization terms in many practical cases, (iii) obtain natural serendipity elements in many practical cases, and (vi) effectively treat also nearly incompressible materials.