A Survey on Automated Fact Checking. Fact checking has become increasingly important due to the speed with which both information and misinformation can spread in the modern media ecosystem. Therefore, researchers have been exploring how fact checking can be automated, using techniques based on natural language processing, machine learning, knowledge representation, and databases to automatically predict the veracity of claims. In this paper, we survey automated fact checking stemming from natural language processing, and discuss its connections to related tasks and disciplines. In this process, we present an overview of existing datasets and models, aiming to unify the various definitions given and identify common concepts. Finally, we highlight challenges for future research.


Localised Hilbert modules and weak noncommutative Cartan pairs. We define the localisation of a Hilbert module in analogy to the local multiplier algebra. We use properties of this localisation to enrich non closed actions on C algebras to closed actions on local multiplier algebras, and descend known results on such closed actions down to their unclosed counterparts. We define weak Cartan inclusions and characterise them as crossed products by inverse semigroup actions. We show that in the commutative case we show that weak Cartan subalgebras are maximal abelian, thereby generalising the case studied by Renault.


Towards More Effective PRM based Crowd Counting via A Multi resolution Fusion and Attention Network. The paper focuses on improving the recent plug and play patch rescaling module (PRM) based approaches for crowd counting. In order to make full use of the PRM potential and obtain more reliable and accurate results for challenging images with crowd variation, large perspective, extreme occlusions, and cluttered background regions, we propose a new PRM based multi resolution and multi task crowd counting network by exploiting the PRM module with more effectiveness and potency. The proposed model consists of three deep layered branches with each branch generating feature maps of different resolutions. These branches perform a feature level fusion across each other to build the vital collective knowledge to be used for the final crowd estimate. Additionally, early stage feature maps undergo visual attention to strengthen the later stage channels understanding of the foreground regions. The integration of these deep branches with the PRM module and the early attended blocks proves to be more effective than the original PRM based schemes through extensive numerical and visual evaluations on four benchmark datasets. The proposed approach yields a significant improvement by a margin of 12.6 in terms of the RMSE evaluation criterion. It also outperforms state of the art methods in cross dataset evaluations.


Single Image Texture Translation for Data Augmentation. Recent advances in image synthesis enables one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with results evaluated largely in a subjective manner. Relatively few works in this area, however, study the potential use of semantic image translation methods for image recognition tasks. In this paper, we explore the use of Single Image Texture Translation (SITT) for data augmentation. We first propose a lightweight model for translating texture to images based on a single input of source texture, allowing for fast training and testing. Based on SITT, we then explore the use of augmented data in long tailed and few shot image classification tasks. We find the proposed method is capable of translating input data into a target domain, leading to consistent improved image recognition performance. Finally, we examine how SITT and related image translation methods can provide a basis for a data efficient, augmentation engineering approach to model training.


Automatic Firmware Emulation through Invalidity guided Knowledge Inference (Extended Version). Emulating firmware for microcontrollers is challenging due to the tight coupling between the hardware and firmware. This has greatly impeded the application of dynamic analysis tools to firmware analysis. The state of the art work automatically models unknown peripherals by observing their access patterns, and then leverages heuristics to calculate the appropriate responses when unknown peripheral registers are accessed. However, we empirically found that this approach and the corresponding heuristics are frequently insufficient to emulate firmware. In this work, we propose a new approach called uEmu to emulate firmware with unknown peripherals. Unlike existing work that attempts to build a general model for each peripheral, our approach learns how to correctly emulate firmware execution at individual peripheral access points. It takes the image as input and symbolically executes it by representing unknown peripheral registers as symbols. During symbolic execution, it infers the rules to respond to unknown peripheral accesses. These rules are stored in a knowledge base, which is referred to during the dynamic firmware analysis. uEmu achieved a passing rate of 95 in a set of unit tests for peripheral drivers without any manual assistance. We also evaluated uEmu with real world firmware samples and new bugs were discovered.


Adversarial Open Domain Adaptation for Sketch to Photo Synthesis. In this paper, we explore open domain sketch to photo translation, which aims to synthesize a realistic photo from a freehand sketch with its class label, even if the sketches of that class are missing in the training data. It is challenging due to the lack of training supervision and the large geometric distortion between the freehand sketch and photo domains. To synthesize the absent freehand sketches from photos, we propose a framework that jointly learns sketch to photo and photo to sketch generation. However, the generator trained from fake sketches might lead to unsatisfying results when dealing with sketches of missing classes, due to the domain gap between synthesized sketches and real ones. To alleviate this issue, we further propose a simple yet effective open domain sampling and optimization strategy to "fool" the generator into treating fake sketches as real ones. Our method takes advantage of the learned sketch to photo and photo to sketch mapping of in domain data and generalizes it to the open domain classes. We validate our method on the Scribble and SketchyCOCO datasets. Compared with the recent competing methods, our approach shows impressive results in synthesizing realistic color, texture, and maintaining the geometric composition for various categories of open domain sketches. Our code is available at https github.com Mukosame AODA


Towards Explaining Adversarial Examples Phenomenon in Artificial Neural Networks. In this paper, we study the adversarial examples existence and adversarial training from the standpoint of convergence and provide evidence that pointwise convergence in ANNs can explain these observations. The main contribution of our proposal is that it relates the objective of the evasion attacks and adversarial training with concepts already defined in learning theory. Also, we extend and unify some of the other proposals in the literature and provide alternative explanations on the observations made in those proposals. Through different experiments, we demonstrate that the framework is valuable in the study of the phenomenon and is applicable to real world problems.


Isostables for stochastic oscillators. Thomas and Lindner (2014, Phys.Rev.Lett.) defined an asymptotic phase for stochastic oscillators as the angle in the complex plane made by the eigenfunction, having a complex eigenvalue with a least negative real part, of the backward Kolmogorov (or stochastic Koopman) operator. We complete the phase amplitude description of noisy oscillators by defining the stochastic isostable coordinate as the eigenfunction with the least negative nontrivial real eigenvalue. Our results suggest a framework for stochastic limit cycle dynamics that encompasses noise induced oscillations.


Graph Free Knowledge Distillation for Graph Neural Networks. Knowledge distillation (KD) transfers knowledge from a teacher network to a student by enforcing the student to mimic the outputs of the pretrained teacher on training data. However, data samples are not always accessible in many cases due to large data sizes, privacy, or confidentiality. Many efforts have been made on addressing this problem for convolutional neural networks (CNNs) whose inputs lie in a grid domain within a continuous space such as images and videos, but largely overlook graph neural networks (GNNs) that handle non grid data with different topology structures within a discrete space. The inherent differences between their inputs make these CNN based approaches not applicable to GNNs. In this paper, we propose to our best knowledge the first dedicated approach to distilling knowledge from a GNN without graph data. The proposed graph free KD (GFKD) learns graph topology structures for knowledge transfer by modeling them with multivariate Bernoulli distribution. We then introduce a gradient estimator to optimize this framework. Essentially, the gradients w.r.t. graph structures are obtained by only using GNN forward propagation without back propagation, which means that GFKD is compatible with modern GNN libraries such as DGL and Geometric. Moreover, we provide the strategies for handling different types of prior knowledge in the graph data or the GNNs. Extensive experiments demonstrate that GFKD achieves the state of the art performance for distilling knowledge from GNNs without training data.


Kolyvagin classes versus non cristalline diagonal classes. Let E mathbb Q be an elliptic curve having multiplicative reduction at a prime p . Let (g,h) be a pair of eigenforms of weight 1 arising as the theta series of an imaginary quadratic field K , and assume that the triple product L function L(f,g,h,s) is self dual and does not vanish at the central critical point s 1 . The main result of this article is a formula expressing the p adic iterated integrals introduced in DLR to the Kolyvagin classes associated by Bertolini and Darmon to a system of Heegner points on E .


Algebraic Tensor Products Revisited Axiomatic Approach. This is an expository paper on tensor products where the standard approaches for constructing concrete instances of algebraic tensor products of linear spaces, via quotient spaces or via linear maps of bilinear maps, are reviewed by reducing them to different but isomorphic interpretations of an abstract notion, viz., the universal property, which is based on a pair of axioms.


Pose Estimation and 3D Reconstruction of Vehicles from Stereo Images Using a Subcategory Aware Shape Prior. The 3D reconstruction of objects is a prerequisite for many highly relevant applications of computer vision such as mobile robotics or autonomous driving. To deal with the inverse problem of reconstructing 3D objects from their 2D projections, a common strategy is to incorporate prior object knowledge into the reconstruction approach by establishing a 3D model and aligning it to the 2D image plane. However, current approaches are limited due to inadequate shape priors and the insufficiency of the derived image observations for a reliable alignment with the 3D model. The goal of this paper is to show how 3D object reconstruction can profit from a more sophisticated shape prior and from a combined incorporation of different observation types inferred from the images. We introduce a subcategory aware deformable vehicle model that makes use of a prediction of the vehicle type for a more appropriate regularisation of the vehicle shape. A multi branch CNN is presented to derive predictions of the vehicle type and orientation. This information is also introduced as prior information for model fitting. Furthermore, the CNN extracts vehicle keypoints and wireframes, which are well suited for model to image association and model fitting. The task of pose estimation and reconstruction is addressed by a versatile probabilistic model. Extensive experiments are conducted using two challenging real world data sets on both of which the benefit of the developed shape prior can be shown. A comparison to state of the art methods for vehicle pose estimation shows that the proposed approach performs on par or better, confirming the suitability of the developed shape prior and probabilistic model for vehicle reconstruction.


Fast Goodstein Walks. We define a variant of the Goodstein process based on fast growing functions and show that it terminates, but this fact is not provable in Kripke Platek set theory or other theories of strength the Bachmann Howard ordinal. We moreover show that this Goodstein process is of maximal length, so that any alternative Goodstein process based on the same fast growing functions will also terminate.


Mean Sombor index. We introduce a degree based variable topological index inspired on the power (or generalized) mean. We name this new index as the mean Sombor index mSO alpha(G) sum uv in E(G) left left( d u alpha d v alpha right) 2 right 1 alpha . Here, uv denotes the edge of the graph G connecting the vertices u and v , d u is the degree of the vertex u , and alpha in mathbb R backslash 0 . We also consider the limit cases mSO alpha to 0 (G) and mSO alpha to pm infty (G) . Indeed, for given values of alpha , the mean Sombor index is related to well known topological indices such as the inverse sum indeg index, the reciprocal Randic index, the first Zagreb index, the Stolarsky Puebla index and several Sombor indices. Moreover, through a quantitative structure property relationship (QSPR) analysis we show that mSO alpha(G) correlates well with several physicochemical properties of octane isomers. Some mathematical properties of mean Sombor indices as well as bounds and new relationships with known topological indices are also discussed.


Energy conservation for the non resistive MHD equations with physical boundaries. In this paper, we study the energy equality for weak solutions to the non resistive MHD equations with physical boundaries. Although the equations of magnetic field b are of hyperbolic type, and the boundary effects are considered, we still prove the global energy equality provided that u in L q loc left(0, T L p ( Omega) right) text for any frac 1 q frac 1 p leq frac 1 2 , text with p geq 4, text and b in L r loc left(0, T L s ( Omega) right) text for any frac 1 r frac 1 s leq frac 1 2 , text with s geq 4 . In particular, compared with the existed results, we do not require any boundary layer assumptions and additional conditions on the pressure P . Our result requires the regularity of boundary partial Omega is only Lipschitz which is the minimum requirement to make the boundary condition b cdot n sense. The proof is based on the important properties of weak solutions of the nonstationary Stokes system and the separate mollification of weak solutions from the boundary effect by considering a non standard local energy equality and transform the boundary effects into the estimates of the gradient of cut off functions.


Adaptive Approach Phase Guidance for a Hypersonic Glider via Reinforcement Meta Learning. We use Reinforcement Meta Learning to optimize an adaptive guidance system suitable for the approach phase of a gliding hypersonic vehicle. Adaptability is achieved by optimizing over a range of off nominal flight conditions including perturbation of aerodynamic coefficient parameters, actuator failure scenarios, and sensor noise. The system maps observations directly to commanded bank angle and angle of attack rates. These observations include a velocity field tracking error formulated using parallel navigation, but adapted to work over long trajectories where the Earth's curvature must be taken into account. Minimizing the tracking error keeps the curved space line of sight to the target location aligned with the vehicle's velocity vector. The optimized guidance system will then induce trajectories that bring the vehicle to the target location with a high degree of accuracy at the designated terminal speed, while satisfying heating rate, load, and dynamic pressure constraints. We demonstrate the adaptability of the guidance system by testing over flight conditions that were not experienced during optimization. The guidance system's performance is then compared to that of a linear quadratic regulator tracking an optimal trajectory.


Ruin and dividend measures in the renewal dual risk model. In this manuscript we consider the dual risk model with financial application, where the random gains occur under a renewal process. We particularly work the Erlang(n) case for common distribution of the inter arrival times, from there it is easy to understand that our method or procedures can be generalised to other cases under the matrix exponential family case. We work several and different problems involving future dividends and ruin. We also show that our results are valid even if the usual income condition is not satisfied. In most known works under the dual model, the main target under study have been the calculation of expected discounted future dividends and optimal strategies, where the dividend calculation have been done on aggregate. We can find works, at first using the classical compound Poisson model, then some examples of other renewal Erlang models. Knowing that ruin is ultimately achieved, we find important that dividends should be evaluated on an individual basis, where the early dividend contribution for the aggregate are of utmost importance. From our calculations we can really see how much important is the contribution of the first dividend. Afonso et al. (2013) had worked similar problems for the classical compound Poisson dual model. Besides that we find explicit formulae for both the probability of getting a dividend and the distribution of the amount of a single dividend. We still work the probability distribution of the number of gains to reach a given upper target (like a constant dividend barrier) as well as for the number of gains down to ruin. We complete the study working some illustrative numerical examples that show final numbers for the several problems under study.


Limit cycles for classes of piecewise smooth differential equations separated by the unit circle. In this article we study the existence of limit cycles in families of piecewise smooth differential equations having the unit circle as discontinuity region. We consider families presenting singularities of center or saddle type, visible or invisible, as well as the case without singularities. We establish an upper bound for the number of limit cycles and give examples showing that the maximum number of limit cycles can be reached. We also discuss the existence of homoclinic cycles for such differential equations in the saddle center case.


Text Gestalt Stroke Aware Scene Text Image Super Resolution. In the last decade, the blossom of deep learning has witnessed the rapid development of scene text recognition. However, the recognition of low resolution scene text images remains a challenge. Even though some super resolution methods have been proposed to tackle this problem, they usually treat text images as general images while ignoring the fact that the visual quality of strokes (the atomic unit of text) plays an essential role for text recognition. According to Gestalt Psychology, humans are capable of composing parts of details into the most similar objects guided by prior knowledge. Likewise, when humans observe a low resolution text image, they will inherently use partial stroke level details to recover the appearance of holistic characters. Inspired by Gestalt Psychology, we put forward a Stroke Aware Scene Text Image Super Resolution method containing a Stroke Focused Module (SFM) to concentrate on stroke level internal structures of characters in text images. Specifically, we attempt to design rules for decomposing English characters and digits at stroke level, then pre train a text recognizer to provide stroke level attention maps as positional clues with the purpose of controlling the consistency between the generated super resolution image and high resolution ground truth. The extensive experimental results validate that the proposed method can indeed generate more distinguishable images on TextZoom and manually constructed Chinese character dataset Degraded IC13. Furthermore, since the proposed SFM is only used to provide stroke level guidance when training, it will not bring any time overhead during the test phase. Code is available at https github.com FudanVI FudanOCR tree main text gestalt.


Improving Compositionality of Neural Networks by Decoding Representations to Inputs. In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated strong performance on novel applications, they sacrifice many of the functionalities of traditional software programs. With this as motivation, we take a modest first step towards improving deep learning programs by jointly training a generative model to constrain neural network activations to "decode" back to inputs. We call this design a Decodable Neural Network, or DecNN. Doing so enables a form of compositionality in neural networks, where one can recursively compose DecNN with itself to create an ensemble like model with uncertainty. In our experiments, we demonstrate applications of this uncertainty to out of distribution detection, adversarial example detection, and calibration while matching standard neural networks in accuracy. We further explore this compositionality by combining DecNN with pretrained models, where we show promising results that neural networks can be regularized from using protected features.


Fast, efficient and flexible particle accelerator optimisation using densely connected and invertible neural networks. Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. Finding optimized operation points for these complex machines is a challenging task, however, due to the large number of parameters involved and the underlying non linear dynamics. Here, we introduce two families of data driven surrogate models, based on deep and invertible neural networks, that can replace the expensive physics computer models. These models are employed in multi objective optimisations to find Pareto optimal operation points for two fundamentally different types of particle accelerators. Our approach reduces the time to solution for a multi objective accelerator optimisation up to a factor of 640 and the computational cost up to 98 . The framework established here should pave the way for future on line and real time multi objective optimisation of particle accelerators.


A full characterization of invariant embeddability of unimodular planar graphs. When can a unimodular random planar graph be drawn in the Euclidean or the hyperbolic plane in a way that the distribution of the random drawing is isometry invariant? This question was answered for one ended unimodular graphs in earlier work of Benjamini and Tim 'ar, using the fact that such graphs automatically have locally finite (simply connected) drawings into the plane. For the case of graphs with multiple ends the question was left open. We provide a graph theoretic characterization of graphs that have a locally finite embedding into the plane. Then we prove that such graphs do have a locally finite invariant embedding into the Euclidean or the hyperbolic plane, depending on whether the graph is amenable or not.


Two dimensionally stable self organization arises in simple schooling swimmers through hydrodynamic interactions. We present new constrained and free swimming experiments and simulations of a pair of pitching hydrofoils interacting in a minimal school. The hydrofoils have an out of phase synchronization and they are varied through in line, staggered, and side by side arrangements within the two dimensional interaction plane. It is discovered that there is a textit two dimensionally stable equilibrium point for a side by side arrangement. In fact, this arrangement is super stable, meaning that hydrodynamic forces will passively maintain this arrangement even under external perturbations and the school as a whole has no net forces acting on it, causing it to drift to one side or the other. Moreover, previously discovered textit one dimensionally stable equilibria driven by wake vortex interactions are shown to be, in fact, two dimensionally textit unstable , at least for an out of phase synchronization. Additionally, it is discovered that a trailing edge vortex mechanism provides the restorative force to stabilize a side by side arrangement and the stable equilibrium is further verified for freely swimming foils where dynamic recoil motions are present. When constrained, the swimmers experience a collective thrust and efficiency increase up to 100 and 40 , respectively, in a side by side arrangement, whereas the staggered arrangements output an even higher efficiency improvement of 87 with a 94 increase in thrust. For freely swimming foils, the recoil motion attenuates the improvements at the stable equilibrium, showing a more modest speed and efficiency enhancement of up to 9 and 6 , respectively. These newfound schooling performance and stability characteristics suggest that fluid mediated equilibria may play a role in the control strategies of schooling fish and fish inspired robots.


Long Range Time Synchronisation Methods in LoRaWAN based IoT. LoRa (Long Range) is an LPWAN (low power wide area network) protocol that is part of the IoT family that focusses on long range communication of up to 14km, albeit with delay inherent transmissions. Three IoT based time synchronisation methodologies are analysed, and their efficacy measured through a systematic critical literature review. These include a GNSS based method, an off the shelf GPS hardware resampling method, and the LongShoT method, within the context of vehicular ad hoc networks (VANET), wireless sensor networks (WSN), and long range wide area network (LoRaWAN) respectively. Although two of the three methods are not LoRaWAN specific, the findings obtained from the research are applied to the context of LoRa in the proposed methodology. A methodology for selecting a time synchronisation methodology with regards to LoRa specifically is posited, whereby each requirement of synchronisation objective, energy consumption and costs, scenario and security analysis, application requirements, microcontroller requirements and transceiver requirements are taken into consideration. These are then followed by a fine grain approach to the selection of a particular time sync method. The resultant methodology may not only have implications in the field of research, where practitioners may adopt this literature review as a baseline understanding of time synchronisation methods and obstacles encountered toward LoRa, however developers of applications for the LoRaWAN may adapt the analysed methods outlined within.


Time of flight 3D imaging through multimode optical fibres. Time of flight (ToF) 3D imaging has a wealth of applications, from industrial inspection to movement tracking and gesture recognition. Depth information is recovered by measuring the round trip flight time of laser pulses, which usually requires projection and collection optics with diameters of several centimetres. In this work we shrink this requirement by two orders of magnitude, and demonstrate near video rate 3D imaging through multimode optical fibres (MMFs) the width of a strand of human hair. Unlike conventional imaging systems, MMFs exhibit exceptionally complex light transport resembling that of a highly scattering medium. To overcome this complication, we implement high speed aberration correction using wavefront shaping synchronised with a pulsed laser source, enabling random access scanning of the scene at a rate of sim 23,000 points per second. Using non ballistic light we image moving objects several metres beyond the end of a sim 40 cm long MMF of 50 mu m core diameter, with millimetric depth resolution, at frame rates of sim 5Hz. Our work extends far field depth resolving capabilities to ultra thin micro endoscopes, and will have a broad range of applications to clinical and remote inspection scenarios.


VSGM Enhance robot task understanding ability through visual semantic graph. In recent years, developing AI for robotics has raised much attention. The interaction of vision and language of robots is particularly difficult. We consider that giving robots an understanding of visual semantics and language semantics will improve inference ability. In this paper, we propose a novel method VSGM (Visual Semantic Graph Memory), which uses the semantic graph to obtain better visual image features, improve the robot's visual understanding ability. By providing prior knowledge of the robot and detecting the objects in the image, it predicts the correlation between the attributes of the object and the objects and converts them into a graph based representation and mapping the object in the image to be a top down egocentric map. Finally, the important object features of the current task are extracted by Graph Neural Networks. The method proposed in this paper is verified in the ALFRED (Action Learning From Realistic Environments and Directives) dataset. In this dataset, the robot needs to perform daily indoor household tasks following the required language instructions. After the model is added to the VSGM, the task success rate can be improved by 6 10 .


Slopes of Siegel cusp forms and geometry of compactified Kuga varieties. We study the Kodaira dimension of the compactified n fold Kuga variety over the moduli space of principally polarised abelian g folds. We construct a suitable compactification, which we call a Namikawa compactification, and show that in most cases it has canonical singularities. We then use results about the slope of Siegel modular forms to determine the Kodaira dimension for all g 1 and n 0.


Universal Upper Bound on The Blowup Rate of Nonlinear Schr "odinger Equation with Rotation. In this paper, we prove a universal upper bound on the blowup rate of a focusing nonlinear Schr "odinger equation with an angular momentum under a trapping harmonic potential, assuming that the initial data is radially symmetric in the weighted Sobolev space. The nonlinearity is in the mass supercritical and energy subcritical regime. Numerical simulations are also presented.


The Factual Inconsistency Problem in Abstractive Text Summarization A Survey. Recently, various neural encoder decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models can freely generate summaries without any constraint on the words or phrases used. Moreover, their format is closer to human edited summaries and output is more readable and fluent. However, the neural model's abstraction ability is a double edged sword. A commonly observed problem with the generated summaries is the distortion or fabrication of factual information in the article. This inconsistency between the original text and the summary has caused various concerns over its applicability, and the previous evaluation methods of text summarization are not suitable for this issue. In response to the above problems, the current research direction is predominantly divided into two categories, one is to design fact aware evaluation metrics to select outputs without factual inconsistency errors, and the other is to develop new summarization systems towards factual consistency. In this survey, we focus on presenting a comprehensive review of these fact specific evaluation methods and text summarization models.


physics.med-ph cs.LG physics.bio-ph physics.flu-dyn

Physics informed neural networks for improving cerebral hemodynamics predictions. Determining brain hemodynamics plays a critical role in the diagnosis and treatment of various cerebrovascular diseases. In this work, we put forth a physics informed deep learning framework that augments sparse clinical measurements with fast computational fluid dynamics (CFD) simulations to generate physically consistent and high spatiotemporal resolution of brain hemodynamic parameters. Transcranial Doppler (TCD) ultrasound is one of the most common techniques in the current clinical workflow that enables noninvasive and instantaneous evaluation of blood flow velocity within the cerebral arteries. However, it is spatially limited to only a handful of locations across the cerebrovasculature due to the constrained accessibility through the skull's acoustic windows. Our deep learning framework employs in vivo real time TCD velocity measurements at several locations in the brain and the baseline vessel cross sectional areas acquired from 3D angiography images, and provides high resolution maps of velocity, area, and pressure in the entire vasculature. We validated the predictions of our model against in vivo velocity measurements obtained via 4D flow MRI scans. We then showcased the clinical significance of this technique in diagnosing the cerebral vasospasm (CVS) by successfully predicting the changes in vasospastic local vessel diameters based on corresponding sparse velocities measurements. The key finding here is that the combined effects of uncertainties in outlet boundary condition subscription and modeling physics deficiencies render the conventional purely physics based computational models unsuccessful in recovering accurate brain hemodynamics. Nonetheless, fusing these models with clinical measurements through a data driven approach ameliorates predictions of brain hemodynamic variables.


Balanced Q learning Combining the Influence of Optimistic and Pessimistic Targets. The optimistic nature of the Q learning target leads to an overestimation bias, which is an inherent problem associated with standard Q learning. Such a bias fails to account for the possibility of low returns, particularly in risky scenarios. However, the existence of biases, whether overestimation or underestimation, need not necessarily be undesirable. In this paper, we analytically examine the utility of biased learning, and show that specific types of biases may be preferable, depending on the scenario. Based on this finding, we design a novel reinforcement learning algorithm, Balanced Q learning, in which the target is modified to be a convex combination of a pessimistic and an optimistic term, whose associated weights are determined online, analytically. We prove the convergence of this algorithm in a tabular setting, and empirically demonstrate its superior learning performance in various environments.


Tight Bounds for Approximate Near Neighbor Searching for Time Series under the Fr 'echet Distance. We study the c approximate near neighbor problem under the continuous Fr 'echet distance Given a set of n polygonal curves with m vertices, a radius delta 0 , and a parameter k leq m , we want to preprocess the curves into a data structure that, given a query curve q with k vertices, either returns an input curve with Fr 'echet distance at most c cdot delta to q , or returns that there exists no input curve with Fr 'echet distance at most delta to q . We focus on the case where the input and the queries are one dimensional polygonal curves also called time series and we give a comprehensive analysis for this case. We obtain new upper bounds that provide different tradeoffs between approximation factor, preprocessing time, and query time. Our data structures improve upon the state of the art in several ways. We show that for any 0 varepsilon leq 1 an approximation factor of (1 varepsilon) can be achieved within the same asymptotic time bounds as the previously best result for (2 varepsilon) . Moreover, we show that an approximation factor of (2 varepsilon) can be obtained by using preprocessing time and space O(nm) , which is linear in the input size, and query time in O( frac 1 varepsilon ) k 2 , where the previously best result used preprocessing time in n cdot O( frac m varepsilon k ) k and query time in O(1) k . We complement our upper bounds with matching conditional lower bounds based on the Orthogonal Vectors Hypothesis. Interestingly, some of our lower bounds already hold for any super constant value of k . This is achieved by proving hardness of a one sided sparse version of the Orthogonal Vectors problem as an intermediate problem, which we believe to be of independent interest.


Improving Fairness of AI Systems with Lossless De biasing. In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented groups. Mitigating bias in AI systems to increase overall fairness has emerged as an important challenge. Existing studies on mitigating bias in AI systems focus on eliminating sensitive demographic information embedded in data. Given the temporal and contextual complexity of conceptualizing fairness, lossy treatment of demographic information may contribute to an unnecessary trade off between accuracy and fairness, especially when demographic attributes and class labels are correlated. In this paper, we present an information lossless de biasing technique that targets the scarcity of data in the disadvantaged group. Unlike the existing work, we demonstrate, both theoretically and empirically, that oversampling underrepresented groups can not only mitigate algorithmic bias in AI systems that consistently predict a favorable outcome for a certain group, but improve overall accuracy by mitigating class imbalance within data that leads to a bias towards the majority class. We demonstrate the effectiveness of our technique on real datasets using a variety of fairness metrics.


Mechanical waves in myelinated axon wall. The propagation of an action potential is accompanied by mechanical and thermal effects. Several mathematical models explain the deformation of the unmyelinated axon wall. In this paper, the deformation of the myelinated axon wall is studied. The mathematical model is inspired by the mechanics of microstructured materials. The model involves the improved Heimburg Jackson equation together with another equation of wave motion that describes the process in the myelin sheath. The dispersion analysis of such a model explains the behaviour of group and phase velocities. In addition, it is shown how dissipative effects may influence the process. Numerical calculations demonstrate the changes in velocities and wave profiles in the myelinated axon wall.


Common Bugs in Scratch Programs. Bugs in Scratch programs can spoil the fun and inhibit learning success. Many common bugs are the result of recurring patterns of bad code. In this paper we present a collection of common code patterns that typically hint at bugs in Scratch programs, and the LitterBox tool which can automatically detect them. We empirically evaluate how frequently these patterns occur, and how severe their consequences usually are. While fixing bugs inevitably is part of learning, the possibility to identify the bugs automatically provides the potential to support learners


Template NeRF Towards Modeling Dense Shape Correspondences from Category Specific Object Images. We present neural radiance fields (NeRF) with templates, dubbed Template NeRF, for modeling appearance and geometry and generating dense shape correspondences simultaneously among objects of the same category from only multi view posed images, without the need of either 3D supervision or ground truth correspondence knowledge. The learned dense correspondences can be readily used for various image based tasks such as keypoint detection, part segmentation, and texture transfer that previously require specific model designs. Our method can also accommodate annotation transfer in a one or few shot manner, given only one or a few instances of the category. Using periodic activation and feature wise linear modulation (FiLM) conditioning, we introduce deep implicit templates on 3D data into the 3D aware image synthesis pipeline NeRF. By representing object instances within the same category as shape and appearance variation of a shared NeRF template, our proposed method can achieve dense shape correspondences reasoning on images for a wide range of object classes. We demonstrate the results and applications on both synthetic and real world data with competitive results compared with other methods based on 3D information.


Dynamic QoS Aware Traffic Planning for Time Triggered Flows with Conflict Graphs. Many networked applications, e.g., in the domain of cyber physical systems, require strict service guarantees, usually in the form of jitter and latency bounds, for time triggered traffic flows. It is a notoriously hard problem to compute a network wide traffic plan that satisfies these requirements, and dynamic changes in the flow set add even more challenges. Existing traffic planning methods are ill suited for dynamic scenarios because they either suffer from high computational cost, can result in low network utilization, or provide no explicit guarantees when transitioning to a new traffic plan that incorporates new flows. Therefore, we present a novel approach for dynamic traffic planning of time triggered flows. Our conflict graph based modeling of the traffic planning problem allows to reconfigure active flows to increase the network utilization, while also providing per flow QoS guarantees during the transition to the new traffic plan. Additionally, we introduce a novel heuristic for computing the new traffic plans. Evaluations of our prototypical implementation show that we can efficiently compute new traffic plans in scenarios with hundreds of active flows for a wide range of scenarios.


Synthesizing Machine Learning Programs with PAC Guarantees via Statistical Sketching. We study the problem of synthesizing programs that include machine learning components such as deep neural networks (DNNs). We focus on statistical properties, which are properties expected to hold with high probability e.g., that an image classification model correctly identifies people in images with high probability. We propose novel algorithms for sketching and synthesizing such programs by leveraging ideas from statistical learning theory to provide statistical soundness guarantees. We evaluate our approach on synthesizing list processing programs that include DNN components used to process image inputs, as well as case studies on image classification and on precision medicine. Our results demonstrate that our approach can be used to synthesize programs with probabilistic guarantees.


IntentNet Learning to Predict Intention from Raw Sensor Data. In order to plan a safe maneuver, self driving vehicles need to understand the intent of other traffic participants. We define intent as a combination of discrete high level behaviors as well as continuous trajectories describing future motion. In this paper, we develop a one stage detector and forecaster that exploits both 3D point clouds produced by a LiDAR sensor as well as dynamic maps of the environment. Our multi task model achieves better accuracy than the respective separate modules while saving computation, which is critical to reducing reaction time in self driving applications.


Stream based State Machine Replication. Developing state machine replication protocols for practical use is a complex and labor intensive process because of the myriad of essential tasks (e.g., deployment, communication, recovery) that need to be taken into account in an implementation. In this paper, we show how this problem can be addressed with stream based replication, a novel approach that implements a replication protocol as application on top of a data stream processing framework. With such framework already handling most essential tasks and furthermore providing means for debugging and monitoring, this technique has the key benefit of significantly minimizing overhead for both programmers as well as system operators. Our first stream based protocol Tara tolerates crashes and comprises full fledged mechanisms for request handling, checkpointing, and view changes. Still, Tara's prototype implementation, which is based on Twitter's Heron framework, consists of fewer than 1,500 lines of application level code.


Lee classes on LCK manifolds with potential. An LCK (locally conformally Kahler) manifold is a complex manifold (M,I) equipped with a Hermitian form omega and a closed 1 form theta , called the Lee form, such that d omega theta wedge omega . An LCK manifold with potential is an LCK manifold with a positive Kahler potential on its cover, such that the deck group multiplies the Kahler potential by a constant. A Lee class of an LCK manifold is the cohomology class of the Lee form. We determine the set of Lee classes on LCK manifolds admitting an LCK structure with potential, showing that it is an open half space in H 1(M, mathbb R ) . For Vaisman manifolds, this theorem was proven in 1994 by Tsukada we give a new self contained proof of his result.


Lectures on error analysis of interpolation on simplicial triangulations without the shape regularity assumption, Part 2 Lagrange interpolation on tetrahedrons. This is the second lecture note on the error analysis of interpolation on simplicial elements without the shape regularity assumption (the previous one is arXiv 1908.03894). In this manuscript, we explain the error analysis of Lagrange interpolation on (possibly anisotropic) tetrahedrons. The manuscript is not intended to be a research paper. We hope that, in the future, it will be merged into a textbook on the mathematical theory of the finite element methods.


Multi modal Affect Analysis using standardized data within subjects in the Wild. Human affective recognition is an important factor in human computer interaction. However, the method development with in the wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition method focusing on facial expression (EXP) and valence arousal calculation that was submitted to the Affective Behavior Analysis in the wild (ABAW) 2021 Contest. When annotating facial expressions from a video, we thought that it would be judged not only from the features common to all people, but also from the relative changes in the time series of individuals. Therefore, after learning the common features for each frame, we constructed a facial expression estimation model and valence arousal model using time series data after combining the common features and the standardized features for each video. Furthermore, the above features were learned using multi modal data such as image features, AU, Head pose, and Gaze. In the validation set, our model achieved a facial expression score of 0.546. These verification results reveal that our proposed framework can improve estimation accuracy and robustness effectively.


Explaining classifiers to understand coarse grained models. Bottom up coarse grained molecular dynamics models are parameterized using complex effective Hamiltonians. These models are typically optimized to approximate high dimensional data from atomistic simulations. In contrast, human validation of these models is often limited to low dimensional statistics that do not necessarily differentiate between the CG model and said atomistic simulations. We propose that explainable machine learning can directly convey high dimensional error to scientists and use Shapley additive explanations do so in two coarse grained protein models.


Day to day and seasonal regularity of network passenger delay for metro networks. In an effort to improve user satisfaction and transit image, transit service providers worldwide offer delay compensations. Smart card data enables the estimation of passenger delays throughout the network and aid in monitoring service performance. Notwithstanding, in order to prioritize measures for improving service reliability and hence reducing passenger delays, it is paramount to identify the system components stations and track segments where most passenger delay occurs. To this end, we propose a novel method for estimating network passenger delay from individual trajectories. We decompose the delay along a passenger trajectory into its corresponding track segment delay, initial waiting time and transfer delay. We distinguish between two different types of passenger delay in relation to the public transit network average passenger delay and total passenger delay. We employ temporal clustering on these two quantities to reveal daily and seasonal regularity in delay patterns of the transit network. The estimation and clustering methods are demonstrated on one year of data from Washington metro network. The data consists of schedule information and smart card data which includes passenger train assignment of the metro network for the months of August 2017 to August 2018. Our findings show that the average passenger delay is relatively stable throughout the day. The temporal clustering reveals pronounced and recurrent and thus predictable daily and weekly patterns with distinct characteristics for certain months.


MAUVE Measuring the Gap Between Neural Text and Human Text using Divergence Frontiers. As major progress is made in open ended text generation, measuring how close machine generated text is to human language remains a critical open problem. We introduce MAUVE, a comparison measure for open ended text generation, which directly compares the learnt distribution from a text generation model to the distribution of human written text using divergence frontiers. MAUVE scales up to modern text generation models by computing information divergences in a quantized embedding space. Through an extensive empirical study on three open ended generation tasks, we find that MAUVE identifies known properties of generated text, scales naturally with model size, and correlates with human judgments, with fewer restrictions than existing distributional evaluation metrics.


Scattering and non scattering of the Hartree type nonlinear Dirac system at critical regularity. We consider Cauchy problem of the Hartree type nonlinear Dirac equation with potentials given by V b(x) frac1 4 pi frac e b x x , (b ge 0) . In previous works, a standard argument is to utilise null form estimates in order to prove global well posedness for H s data, s 0 . However, the null structure inside the equations is not enough to attain the critical regularity. We impose an extra regularity assumption with respect to the angular variable. Firstly, we prove global well posedness and scattering of Dirac equations with Hartree type nonlinearity for b 0 for small L 2 x data with additional angular regularity. We also show that only small amount of angular regularity is required to obtain global existence of solutions. Secondly, we obtain non scattering result for a certain class of solutions with the Coulomb potential b 0 .


Concepts, Properties and an Approach for Compositional Generalization. Compositional generalization is the capacity to recognize and imagine a large amount of novel combinations from known components. It is a key in human intelligence, but current neural networks generally lack such ability. This report connects a series of our work for compositional generalization, and summarizes an approach. The first part contains concepts and properties. The second part looks into a machine learning approach. The approach uses architecture design and regularization to regulate information of representations. This report focuses on basic ideas with intuitive and illustrative explanations. We hope this work would be helpful to clarify fundamentals of compositional generalization and lead to advance artificial intelligence.


Quantitative Human Paleogenetics what can ancient DNA tell us about complex trait evolution?. Genetic association data from national biobanks and large scale association studies have provided new prospects for understanding the genetic evolution of complex traits and diseases in humans. In turn, genomes from ancient human archaeological remains are now easier than ever to obtain, and provide a direct window into changes in frequencies of trait associated alleles in the past. This has generated a new wave of studies aiming to analyse the genetic component of traits in historic and prehistoric times using ancient DNA, and to determine whether any such traits were subject to natural selection. In humans, however, issues about the portability and robustness of complex trait inference across different populations are particularly concerning when predictions are extended to individuals that died thousands of years ago, and for which little, if any, phenotypic validation is possible. In this review, we discuss the advantages of incorporating ancient genomes into studies of trait associated variants, the need for models that can better accommodate ancient genomes into quantitative genetic frameworks, and the existing limits to inferences about complex trait evolution, particularly with respect to past populations.


On Linear Time Decidability of Differential Privacy for Programs with Unbounded Inputs. We introduce an automata model for describing interesting classes of differential privacy mechanisms algorithms that include known mechanisms from the literature. These automata can model algorithms whose inputs can be an unbounded sequence of real valued query answers. We consider the problem of checking whether there exists a constant d such that the algorithm described by these automata are d epsilon differentially private for all positive values of the privacy budget parameter epsilon . We show that this problem can be decided in time linear in the automaton's size by identifying a necessary and sufficient condition on the underlying graph of the automaton. This paper's results are the first decidability results known for algorithms with an unbounded number of query answers taking values from the set of reals.


On reductive subgroups of reductive groups having invariants in almost all representations. Let G and tilde G be connected complex reductive Lie groups, G semisimple. Let Lambda be the monoid of dominant weights for a positive root system Delta , and let l(w) be the length of a Weyl group element w . Let V lambda denote an irreducible G module of highest weight lambda in Lambda . For any closed embedding iota tilde G subset G , we consider Property (A) quad forall lambda in Lambda , exists q in mathbb N such that V q lambda tilde G ne0 . A necessary condition for (A) is for G to have no simple factors to which G projects surjectively. We show that this condition is sufficient if tilde G is of type bf A 1 or bf E 8 . We define and study an integral invariant of a root system, ell G min ell lambda lambda in Lambda setminus 0 , where ell lambda min l(w) w lambda notin rm Cone ( Delta ) . We derive the following sufficient condition for (A), independent of iota ell G tilde Delta 0 Longrightarrow (A). We compute ell G and related data for all simple G , except bf E 8 , where we obtain lower and upper bounds. We consider a stronger property (A k ) defined in terms of Geometric Invariant Theory, related to extreme values of codimensions of unstable loci, and derive a sufficient condition in the form ell G tilde Delta k . The invariant ell G proves too week to handle G SL n and we employ a companion ell G rm sd to infer (A k ) for a larger class of subgroups. We derive corollaries on Mori theoretic properties of GIT quotients.


Efficient and Effective Generation of Test Cases for Pedestrian Detection Search based Software Testing of Baidu Apollo in SVL. With the growing capabilities of autonomous vehicles, there is a higher demand for sophisticated and pragmatic quality assurance approaches for machine learning enabled systems in the automotive AI context. The use of simulation based prototyping platforms provides the possibility for early stage testing, enabling inexpensive testing and the ability to capture critical corner case test scenarios. Simulation based testing properly complements conventional on road testing. However, due to the large space of test input parameters in these systems, the efficient generation of effective test scenarios leading to the unveiling of failures is a challenge. This paper presents a study on testing pedestrian detection and emergency braking system of the Baidu Apollo autonomous driving platform within the SVL simulator. We propose an evolutionary automated test generation technique that generates failure revealing scenarios for Apollo in the SVL environment. Our approach models the input space using a generic and flexible data structure and benefits a multi criteria safety based heuristic for the objective function targeted for optimization. This paper presents the results of our proposed test generation technique in the 2021 IEEE Autonomous Driving AI Test Challenge. In order to demonstrate the efficiency and effectiveness of our approach, we also report the results from a baseline random generation technique. Our evaluation shows that the proposed evolutionary test case generator is more effective at generating failure revealing test cases and provides higher diversity between the generated failures than the random baseline.


SoK Anti Facial Recognition Technology. The rapid adoption of facial recognition (FR) technology by both government and commercial entities in recent years has raised concerns about civil liberties and privacy. In response, a broad suite of so called "anti facial recognition" (AFR) tools has been developed to help users avoid unwanted facial recognition. The set of AFR tools proposed in the last few years is wide ranging and rapidly evolving, necessitating a step back to consider the broader design space of AFR systems and long term challenges. This paper aims to fill that gap and provides the first comprehensive analysis of the AFR research landscape. Using the operational stages of FR systems as a starting point, we create a systematic framework for analyzing the benefits and tradeoffs of different AFR approaches. We then consider both technical and social challenges facing AFR tools and propose directions for future research in this field.


Approximate Knowledge Graph Query Answering From Ranking to Binary Classification. Large, heterogeneous datasets are characterized by missing or even erroneous information. This is more evident when they are the product of community effort or automatic fact extraction methods from external sources, such as text. A special case of the aforementioned phenomenon can be seen in knowledge graphs, where this mostly appears in the form of missing or incorrect edges and nodes. Structured querying on such incomplete graphs will result in incomplete sets of answers, even if the correct entities exist in the graph, since one or more edges needed to match the pattern are missing. To overcome this problem, several algorithms for approximate structured query answering have been proposed. Inspired by modern Information Retrieval metrics, these algorithms produce a ranking of all entities in the graph, and their performance is further evaluated based on how high in this ranking the correct answers appear. In this work we take a critical look at this way of evaluation. We argue that performing a ranking based evaluation is not sufficient to assess methods for complex query answering. To solve this, we introduce Message Passing Query Boxes (MPQB), which takes binary classification metrics back into use and shows the effect this has on the recently proposed query embedding method MPQE.


Saguaro Efficient Processing of Transactions in Wide Area Networks using a Hierarchical Permissioned Blockchain. The next frontier for the Internet leading by innovations in mobile computing, in particular, 5G, together with blockchains' transparency, immutability, provenance, and authenticity, indicates the potentials of running a new generation of applications on the mobile internet. A 5G enabled blockchain system is structured as a hierarchy and needs to deal with different challenges such as maintaining blockchain ledger at different spatial domains and various levels of the networks, efficient processing of cross domain transactions, establishing consensus among heterogeneous nodes, and supporting delay tolerant mobile transactions. In this paper, we present Saguaro, a hierarchical permissioned blockchain designed specifically for Internet scale mobile networks. Saguaro benefits from the hierarchical structure of mobile network infrastructure to address the aforementioned challenges. Our extensive experimental results demonstrate the high potential of Saguaro being the first 5G enabled permissioned blockchain system in the community.


Acylindrically hyperbolic groups and their quasi isometrically embedded subgroups. We abstract the notion of an A QI triple from a number of examples in geometric group theory. Such a triple (G,X,H) consists of a group G acting on a Gromov hyperbolic space X, acylindrically along a finitely generated subgroup H which is quasi isometrically embedded by the action. Examples include strongly quasi convex subgroups of relatively hyperbolic groups, convex cocompact subgroups of mapping class groups, many known convex cocompact subgroups of Out(Fn), and groups generated by powers of independent loxodromic WPD elements of a group acting on a Gromov hyperbolic space. We initiate the study of intersection and combination properties of A QI triples. Under the additional hypothesis that G is finitely generated, we use a method of Sisto to show that H is stable. We apply theorems of Kapovich Rafi and Dowdall Taylor to analyze the Gromov boundary of an associated cone off. We close with some examples and questions.


Calculations of the norms for monotone operators on the cones of functions with monotonicity properties. The paper is devoted to the problem of exact calculation of the norms in ideal spaces for monotone operators on the cones of functions with monotonicity properties. We implement a general approach to this problem that covers many concrete variants of monotone operators in ideal spaces and different monotonicity conditions for functions. As applications, we calculate the norms of some integral operators on the cones, associate norms over some cones in Lebesgue spaces, the norms of the dilation operator and embedding operators on weighted Lorentz spaces with general weights. Under some more general conditions, we present order sharp estimates for Hardy type operators on the cones.


Self interpretable Convolutional Neural Networks for Text Classification. Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by exploiting the local linear models inherent in ReLU DNNs. The CNN model combines the word embedding through convolutional layers, filters them using max pooling, and optimizes using a ReLU DNN for classification. To get an overall self interpretable model, the system of local linear models from the ReLU DNN are mapped back through the max pool filter to the appropriate n grams. Our results on experimental datasets demonstrate that our proposed technique produce parsimonious models that are self interpretable and have comparable performance with respect to a more complex CNN model. We also study the impact of the complexity of the convolutional layers and the classification layers on the model performance.


Multiple Oracle Algorithm For General Sum Continuous Games. Continuous games have compact strategy sets and continuous utility functions. Such games can have a highly complicated structure of Nash equilibria. Algorithms and numerical methods for the equilibrium computation are known only for particular classes of continuous games such as two person polynomial games or games with pure equilibria. This contribution focuses on the computation and approximation of a mixed strategy equilibrium for the whole class of multiplayer general sum continuous games. We extend vastly the scope of applicability of the double oracle algorithm, which was initially designed and proved to converge only for two person zero sum games. Specifically, we propose an iterative strategy generation technique, which splits the original problem into the master problem with only a finite subset of strategies being considered, and the subproblem in which an oracle finds the best response of each player. This simple method is guaranteed to recover an approximate equilibrium in finitely many iterations. Further, we argue that the Wasserstein distance (the earth mover's distance) is the right metric on the space of mixed strategies for our purposes. Our main result is the convergence of this algorithm in the Wasserstein distance to an equilibrium of the original continuous game. The numerical experiments show the performance of our method on several examples of games appearing in the literature.


Visibility aware Trajectory Optimization with Application to Aerial Tracking. The visibility of targets determines performance and even success rate of various applications, such as active slam, exploration, and target tracking. Therefore, it is crucial to take the visibility of targets into explicit account in trajectory planning. In this paper, we propose a general metric for target visibility, considering observation distance and angle as well as occlusion effect. We formulate this metric into a differentiable visibility cost function, with which spatial trajectory and yaw can be jointly optimized. Furthermore, this visibility aware trajectory optimization handles dynamic feasibility of position and yaw simultaneously. To validate that our method is practical and generic, we integrate it into a customized quadrotor tracking system. The experimental results show that our visibility aware planner performs more robustly and observes targets better. In order to benefit related researches, we release our code to the public.


Towards a Zero Trust Micro segmentation Network Security Strategy An Evaluation Framework. Micro segmentation is an emerging security technique that separates physical networks into isolated logical micro segments (workloads). By tying fine grained security policies to individual workloads, it limits the attacker's ability to move laterally through the network, even after infiltrating the perimeter defences. While micro segmentation is proved to be effective for shrinking enterprise networks attack surface, its impact assessment is almost absent in the literature. This research is dedicated to developing an analytical framework to characterise and quantify the effectiveness of micro segmentation on enhancing networks security. We rely on a twofold graph feature based framework of the network connectivity and attack graphs to evaluate the network exposure and robustness, respectively. While the former assesses the network assets connectedness, reachability and centrality, the latter depicts the ability of the network to resist goal oriented attackers. Tracking the variations of formulated metrics values post the deployment of micro segmentation reveals exposure reduction and robustness improvement in the range of 60 90 .


Multivariable Function for New Complete Complementary Codes With Arbitrary Lengths. This paper is devoted to efficient design of complete complementary codes (CCCs) which have found wide applications in coding, signal processing and wireless communication, thanks to their ideal auto and cross correlation sum properties. A major motivation of this research is that the existing state of the art can generate CCCs with certain lengths only and therefore may not be able to meet the diverse requirements in practice. We introduce a new tool called multivariable functions with which we propose a direct construction of CCCs with any textit arbitrary lengths in the form of prod i 1 k p i m i , where k is a positive integer, p 1,p 2, hdots,p k are prime numbers, and m 1,m 2, hdots,m k are positive integers. The proposed set size is given by prod i 1 k p i n i ( n 1,n 2, hdots,n k positive integers), which covers all possible positive integers greater than 1. For k 1 and p 1 2 , our proposed construction reduces to the exact Golay Davis Jedwab (GDJ) sequence generator as a special case. For k 1 and p 1 p 2 cdots p k 2 , it gives rise to the conventional CCCs with power of two lengths obtained from generalized Boolean functions. Moreover, we introduce a linear code in connection with the proposed sets of CCCs.


Instantons and the path to intermittency in turbulent flows. The physical processes leading to anomalous fluctuations in turbulent flows, referred to as intermittency, are still challenging. Here, we use an approach based on instanton theory for the velocity increment dynamics through scales. Cascade trajectories with negative stochastic thermodynamics entropy exchange values lead to anomalous increments at small scales. These trajectories concentrate around an instanton, which is the minimum of an effective action produced by turbulent fluctuations. The connection between entropy from stochastic thermodynamics and the related instanton provides a new perspective on the cascade process and the intermittency phenomenon.


Enabling NAS with Automated Super Network Generation. Recent Neural Architecture Search (NAS) solutions have produced impressive results training super networks and then deriving subnetworks, a.k.a. child models that outperform expert crafted models from a pre defined search space. Efficient and robust subnetworks can be selected for resource constrained edge devices, allowing them to perform well in the wild. However, constructing super networks for arbitrary architectures is still a challenge that often prevents the adoption of these approaches. To address this challenge, we present BootstrapNAS, a software framework for automatic generation of super networks for NAS. BootstrapNAS takes a pre trained model from a popular architecture, e.g., ResNet 50, or from a valid custom design, and automatically creates a super network out of it, then uses state of the art NAS techniques to train the super network, resulting in subnetworks that significantly outperform the given pre trained model. We demonstrate the solution by generating super networks from arbitrary model repositories and make available the resulting super networks for reproducibility of the results.


Out of Distribution Example Detection in Deep Neural Networks using Distance to Modelled Embedding. Adoption of deep learning in safety critical systems raise the need for understanding what deep neural networks do not understand after models have been deployed. The behaviour of deep neural networks is undefined for so called out of distribution examples. That is, examples from another distribution than the training set. Several methodologies to detect out of distribution examples during prediction time have been proposed, but these methodologies constrain either neural network architecture, how the neural network is trained, suffer from performance overhead, or assume that the nature of out of distribution examples are known a priori. We present Distance to Modelled Embedding (DIME) that we use to detect out of distribution examples during prediction time. By approximating the training set embedding into feature space as a linear hyperplane, we derive a simple, unsupervised, highly performant and computationally efficient method. DIME allows us to add prediction time detection of out of distribution examples to neural network models without altering architecture or training while imposing minimal constraints on when it is applicable. In our experiments, we demonstrate that by using DIME as an add on after training, we efficiently detect out of distribution examples during prediction and match state of the art methods while being more versatile and introducing negligible computational overhead.


Centralised Connectivity Preserving Transformations for Programmable Matter A Minimal Seed Approach. We study a model of programmable matter systems consisting of n devices lying on a 2 dimensional square grid which are able to perform the minimal mechanical operation of rotating around each other. The goal is to transform an initial shape A into a target shape B. We investigate the class of shapes which can be constructed in such a scenario under the additional constraint of maintaining global connectivity at all times. We focus on the scenario of transforming nice shapes, a class of shapes consisting of a central line L where for all nodes u in S either u in L or u is connected to L by a line of nodes perpendicular to L . We prove that by introducing a minimal 3 node seed it is possible for the canonical shape of a line of n nodes to be transformed into a nice shape of n 1 nodes. We use this to show that a 4 node seed enables the transformation of nice shapes of size n into any other nice shape of size n in O(n 2) time. We leave as an open problem the expansion of the class of shapes which can be constructed using such a seed to include those derived from nice shapes.


When is a planar rod configuration infinitesimally rigid?. We provide a way of determining the infinitesimal rigidity of rod configurations realizing a rank two incidence geometry in the Euclidean plane. We model each rod with a cone over its point set and prove that the resulting geometric realization of the incidence geometry is infinitesimally rigid in regular position if and only if the resulting cone graph is infinitesimally rigid in generic position. This is a generalization of the Molecular conjecture.


Toroidal homology spheres and SU(2) representations. We prove that if an integer homology three sphere contains an embedded incompressible torus, then its fundamental group admits irreducible SU(2) representations. Our methods use instanton Floer homology, and in particular the surgery exact triangle, holonomy perturbations, and a non vanishing result due to Kronheimer Mrowka, as well as results about surgeries on cables due to Gordon.


Progress in Self Certified Neural Networks. A learning method is self certified if it uses all available data to simultaneously learn a predictor and certify its quality with a tight statistical certificate that is valid on unseen data. Recent work has shown that neural network models trained by optimising PAC Bayes bounds lead not only to accurate predictors, but also to tight risk certificates, bearing promise towards achieving self certified learning. In this context, learning and certification strategies based on PAC Bayes bounds are especially attractive due to their ability to leverage all data to learn a posterior and simultaneously certify its risk with a tight numerical certificate. In this paper, we assess the progress towards self certification in probabilistic neural networks learnt by PAC Bayes inspired objectives. We empirically compare (on 4 classification datasets) classical test set bounds for deterministic predictors and a PAC Bayes bound for randomised self certified predictors. We first show that both of these generalisation bounds are not too far from out of sample test set errors. We then show that in data starvation regimes, holding out data for the test set bounds adversely affects generalisation performance, while self certified strategies based on PAC Bayes bounds do not suffer from this drawback, proving that they might be a suitable choice for the small data regime. We also find that probabilistic neural networks learnt by PAC Bayes inspired objectives lead to certificates that can be surprisingly competitive with commonly used test set bounds.


Model Fusion of Heterogeneous Neural Networks via Cross Layer Alignment. Layer wise model fusion via optimal transport, named OTFusion, applies soft neuron association for unifying different pre trained networks to save computational resources. While enjoying its success, OTFusion requires the input networks to have the same number of layers. To address this issue, we propose a novel model fusion framework, named CLAFusion, to fuse neural networks with a different number of layers, which we refer to as heterogeneous neural networks, via cross layer alignment. The cross layer alignment problem, which is an unbalanced assignment problem, can be solved efficiently using dynamic programming. Based on the cross layer alignment, our framework balances the number of layers of neural networks before applying layer wise model fusion. Our experiments indicate that CLAFusion, with an extra finetuning process, improves the accuracy of residual networks on CIFAR10 and CIFAR100 datasets. Furthermore, we explore its practical usage for model compression and knowledge distillation when applying to the teacher student setting.


Computation of some leafwise cohomology. Let G be the group SL(2, mathbb R ) , P subset G be the parabolic subgroup of upper triangular matrices and Gamma subset G be a uniform lattice. A right action of P on Gamma backslash G defines an orbit foliation mathcal F P . We compute a cohomology long exact sequence which contains H 2( mathcal F P) by using a non abelian harmonic analysis on G .


Petri Net Modeling for Ising Model Formulation in Quantum Annealing. Quantum annealing is an emerging new platform for combinatorial optimization, requiring an Ising model formulation for optimization problems. The formulation can be an essential obstacle to the permeation of this innovation into broad areas of everyday life. Our research is aimed at the proposal of a Petri net modeling approach for an Ising model formulation. Although the proposed method requires users to model their optimization problems with Petri nets, this process can be carried out in a relatively straightforward manner if we know the target problem and the simple Petri net modeling rules. With our method, the constraints and objective functions in the target optimization problems are represented as fundamental characteristics of Petri net models, extracted systematically from Petri net models, and then converted into binary quadratic nets, equivalent to Ising models. The proposed method can drastically reduce the difficulty of the Ising model formulation.


Ionic Transport and Selectivity of Electrokinetically Actuated Non Newtonian Flows within a pH Regulated Rectangular Nanochannel. In the present study, the ionic transport and selectivity of electrokinetically driven flow of power law fluids in a long pH regulated rectangular nanochannel are analyzed. The electrical potential and momentum equations are numerically solved through a finite difference procedure for a non uniform grid. Non linear Poisson Boltzmann equation along with the association dissociation reactions on the surface is considered. In addition, numerical simulations with the finite element method in 3D space are performed to compare the results with those obtained from 2D analysis. Moreover, an analytical solution under Debye H "uckel approximation for the limiting case of a slit nanochannel is derived and its results are compared with those obtained from numerical simulations. It is shown that the channel aspect ratio can influence all the physicochemical parameters. It is observed that the mean velocity and the convective ionic conductance are strong descending functions of the flow behavior index. By investigating the non Newtonian fluid behavior effect, it is revealed that its impact on the ionic conductance becomes significant at high values of the solution pH and its variation can alter the anionic transport direction inside the nanochannel. Moreover, it is shown the flow behavior index can strongly influence the ion selectivity of the nanochannel and its variation can be used to let the selectivity go through its maximum as a function of pH.


SoK Privacy Preserving Collaborative Tree based Model Learning. Tree based models are among the most efficient machine learning techniques for data mining nowadays due to their accuracy, interpretability, and simplicity. The recent orthogonal needs for more data and privacy protection call for collaborative privacy preserving solutions. In this work, we survey the literature on distributed and privacy preserving training of tree based models and we systematize its knowledge based on four axes the learning algorithm, the collaborative model, the protection mechanism, and the threat model. We use this to identify the strengths and limitations of these works and provide for the first time a framework analyzing the information leakage occurring in distributed tree based model learning.


Label Propagation Through Optimal Transport. In this paper, we tackle the transductive semi supervised learning problem that aims to obtain label predictions for the given unlabeled data points according to Vapnik's principle. Our proposed approach is based on optimal transport, a mathematical theory that has been successfully used to address various machine learning problems, and is starting to attract renewed interest in semi supervised learning community. The proposed approach, Optimal Transport Propagation (OTP), performs in an incremental process, label propagation through the edges of a complete bipartite edge weighted graph, whose affinity matrix is constructed from the optimal transport plan between empirical measures defined on labeled and unlabeled data. OTP ensures a high degree of predictions certitude by controlling the propagation process using a certainty score based on Shannon's entropy. We also provide a convergence analysis of our algorithm. Experiments task show the superiority of the proposed approach over the state of the art. We make our code publicly available.


The Friedrichs angle and alternating projections in Hilbert C modules. Let B be a C algebra, X a Hilbert C module over B and M,N subset X a pair of complemented submodules. We prove the C module version of von Neumann's alternating projections theorem the sequence (P N P M ) n is Cauchy in the strong module topology if and only if M cap N is the complement of overline M perp N perp . In this case, the strong limit of (P M P N ) n is the orthogonal projection onto M cap N . We use this result and the local global principle to show that the cosine of the Friedrichs angle c(M,N) between any pair of complemented submodules M,N subset X is well defined and that c(M,N) 1 if and only if M cap N is complemented and M N is closed.


On Picard group of moduli space of curves via r spin structures. In this paper we obtain explicit expressions for Pandharipande Pixton Zvonkine relations in second rational cohomology of overline mathcal M g,n and comparing the result with Arbarello Cornalba's theorem we prove Pixton's conjecture in this case.


Heatmaps in soccer event vs tracking datasets. We investigate how similar heatmaps of soccer players are when constructed from (i) event datasets and (ii) tracking datasets. When using event datasets, we show that the scale at which the events are grouped strongly influences the correlation with the tracking heatmaps. Furthermore, there is an optimal scale at which the correlation between event and tracking heatmaps is the highest. However, even at the optimal scale, correlations between both approaches are moderate. Furthermore, there is high heterogeneity in the players' correlation, ranging from negative values to correlations close to the unity. We show that the number of events performed by a player does not crucially determine the level of correlation between both heatmaps. Finally, we analyzed the influence of the player position, showing that defenders are the players with the highest correlations while forwards have the lowest.


Demi shuffle duals of Magnus polynomials in free associative algebra. We study two linear bases of the free associative algebra mathbb Z langle X,Y rangle one is formed by the Magnus polynomials of type ( mathrm ad X k 1 Y) cdots( mathrm ad X k d Y) X k and the other is its dual basis (formed by what we call the demi shuffle' polynomials) with respect to the standard pairing on the monomials of mathbb Z langle X,Y rangle . As an application, we show a formula of Le Murakami, Furusho type that expresses arbitrary coefficients of a group like series J in mathbb C langle langle X,Y rangle rangle by the regular' coefficients of J .


Learning to Ground Visual Objects for Visual Dialog. Visual dialog is challenging since it needs to answer a series of coherent questions based on understanding the visual environment. How to ground related visual objects is one of the key problems. Previous studies utilize the question and history to attend to the image and achieve satisfactory performance, however these methods are not sufficient to locate related visual objects without any guidance. The inappropriate grounding of visual objects prohibits the performance of visual dialog models. In this paper, we propose a novel approach to Learn to Ground visual objects for visual dialog, which employs a novel visual objects grounding mechanism where both prior and posterior distributions over visual objects are used to facilitate visual objects grounding. Specifically, a posterior distribution over visual objects is inferred from both context (history and questions) and answers, and it ensures the appropriate grounding of visual objects during the training process. Meanwhile, a prior distribution, which is inferred from context only, is used to approximate the posterior distribution so that appropriate visual objects can be grounded even without answers during the inference process. Experimental results on the VisDial v0.9 and v1.0 datasets demonstrate that our approach improves the previous strong models in both generative and discriminative settings by a significant margin.


Sanity Checks for Lottery Tickets Does Your Winning Ticket Really Win the Jackpot?. There have been long standing controversies and inconsistencies over the experiment setup and criteria for identifying the "winning ticket" in literature. To reconcile such, we revisit the definition of lottery ticket hypothesis, with comprehensive and more rigorous conditions. Under our new definition, we show concrete evidence to clarify whether the winning ticket exists across the major DNN architectures and or applications. Through extensive experiments, we perform quantitative analysis on the correlations between winning tickets and various experimental factors, and empirically study the patterns of our observations. We find that the key training hyperparameters, such as learning rate and training epochs, as well as the architecture characteristics such as capacities and residual connections, are all highly correlated with whether and when the winning tickets can be identified. Based on our analysis, we summarize a guideline for parameter settings in regards of specific architecture characteristics, which we hope to catalyze the research progress on the topic of lottery ticket hypothesis. Our codes are publicly available at https github.com boone891214 sanity check LTH.


Flexible Clustered Federated Learning for Client Level Data Distribution Shift. Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non IID, imbalanced (statistical heterogeneity) and distribution shifted training data of FL is distributed in the federated network, which will increase the divergences between the local models and the global model, further degrading performance. In this paper, we propose a flexible clustered federated learning (CFL) framework named FlexCFL, in which we 1) group the training of clients based on the similarities between the clients' optimization directions for lower training divergence 2) implement an efficient newcomer device cold start mechanism for framework scalability and practicality 3) flexibly migrate clients to meet the challenge of client level data distribution shift. FlexCFL can achieve improvements by dividing joint optimization into groups of sub optimization and can strike a balance between accuracy and communication efficiency in the distribution shift environment. The convergence and complexity are analyzed to demonstrate the efficiency of FlexCFL. We also evaluate FlexCFL on several open datasets and made comparisons with related CFL frameworks. The results show that FlexCFL can significantly improve absolute test accuracy by 10.6 on FEMNIST compared to FedAvg, 3.5 on FashionMNIST compared to FedProx, 8.4 on MNIST compared to FeSEM. The experiment results show that FlexCFL is also communication efficient in the distribution shift environment.


Regulatory Compliance through Doc2Doc Information Retrieval A case study in EU UK legislation where text similarity has limitations. Major scandals in corporate history have urged the need for regulatory compliance, where organizations need to ensure that their controls (processes) comply with relevant laws, regulations, and policies. However, keeping track of the constantly changing legislation is difficult, thus organizations are increasingly adopting Regulatory Technology (RegTech) to facilitate the process. To this end, we introduce regulatory information retrieval (REG IR), an application of document to document information retrieval (DOC2DOC IR), where the query is an entire document making the task more challenging than traditional IR where the queries are short. Furthermore, we compile and release two datasets based on the relationships between EU directives and UK legislation. We experiment on these datasets using a typical two step pipeline approach comprising a pre fetcher and a neural re ranker. Experimenting with various pre fetchers from BM25 to k nearest neighbors over representations from several BERT models, we show that fine tuning a BERT model on an in domain classification task produces the best representations for IR. We also show that neural re rankers under perform due to contradicting supervision, i.e., similar query document pairs with opposite labels. Thus, they are biased towards the pre fetcher's score. Interestingly, applying a date filter further improves the performance, showcasing the importance of the time dimension.


MindCraft Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks. An ideal integration of autonomous agents in a human world implies that they are able to collaborate on human terms. In particular, theory of mind plays an important role in maintaining common ground during human collaboration and communication. To enable theory of mind modeling in situated interactions, we introduce a fine grained dataset of collaborative tasks performed by pairs of human subjects in the 3D virtual blocks world of Minecraft. It provides information that captures partners' beliefs of the world and of each other as an interaction unfolds, bringing abundant opportunities to study human collaborative behaviors in situated language communication. As a first step towards our goal of developing embodied AI agents able to infer belief states of collaborative partners in situ, we build and present results on computational models for several theory of mind tasks.


Demystifying the Performance of Bluetooth Mesh Experimental Evaluation and Optimization. Mesh connectivity is attractive for Internet of Things (IoT) applications from various perspectives. The recent Bluetooth mesh specification provides a full stack mesh networking solution, potentially for thousands of nodes. Although Bluetooth mesh has been adopted for various IoT applications, its performance aspects are not extensively investigated in literature. This paper provides an experimental evaluation of Bluetooth mesh (using Nordic nRF52840 devices) with an emphasis on those aspects which are not well investigated in literature. Such aspects include evaluation of unicast and group modes, performance under different traffic patterns, impact of message segmentation, and most importantly, latency performance for perfect reliability. The paper also investigates performance enhancement of Bluetooth mesh based on different techniques including parametric adjustments, extended advertisements (introduced in Bluetooth 5.0), power control, and customized relaying. Results provide insights into system level performance of Bluetooth mesh while clarifying various important issues identified in recent studies.


Effects of simulation dimensionality on laser driven electron acceleration and photon emission in hollow micro channel targets. Using two dimensional (2D) and three dimensional (3D) kinetic simulations, we examine the impact of simulation dimensionality on the laser driven electron acceleration and the emission of collimated gamma ray beams from hollow micro channel targets. We demonstrate that the dimensionality of the simulations considerably influences the results of electron acceleration and photon generation owing to the variation of laser phase velocity in different geometries. In a 3D simulation with a cylindrical geometry, the acceleration process of electrons terminates early due to the higher phase velocity of the propagating laser fields in contrast, 2D simulations with planar geometry tend to have prolonged electron acceleration and thus produce much more energetic electrons. The photon beam generated in the 3D setup is found to be more diverged accompanied with a lower conversion efficiency. Our work concludes that the 2D simulation can qualitatively reproduce the features in 3D simulation, but for quantitative evaluations and reliable predictions to facilitate experiment designs, 3D modelling is strongly recommended.


A Bi Encoder LSTM Model For Learning Unstructured Dialogs. Creating a data driven model that is trained on a large dataset of unstructured dialogs is a crucial step in developing Retrieval based Chatbot systems. This paper presents a Long Short Term Memory (LSTM) based architecture that learns unstructured multi turn dialogs and provides results on the task of selecting the best response from a collection of given responses. Ubuntu Dialog Corpus Version 2 was used as the corpus for training. We show that our model achieves 0.8 , 1.0 and 0.3 higher accuracy for Recall 1, Recall 2 and Recall 5 respectively than the benchmark model. We also show results on experiments performed by using several similarity functions, model hyper parameters and word embeddings on the proposed architecture


Stationary 1 dependent Counting Processes from Runs to Bivariate Generating Functions. We give a formula for the bivariate generating function of a stationary 1 dependent counting process in terms of its run probability generating function, with a probabilistic proof. The formula reduces to the well known bivariate generating function of the Eulerian distribution in the case of descents of a sequence of indepependent and identically distributed random variables. The formula is compared with alternative expressions from the theory of determinantal point processes and the combinatorics of sequences.


ResLT Residual Learning for Long tailed Recognition. Deep learning algorithms face great challenges with long tailed data distribution which, however, is quite a common case in real world scenarios. Previous methods tackle the problem from either the aspect of input space (re sampling classes with different frequencies) or loss space (re weighting classes with different weights), suffering from heavy over fitting to tail classes or hard optimization during training. To alleviate these issues, we propose a more fundamental perspective for long tailed recognition, i.e., from the aspect of parameter space, and aims to preserve specific capacity for classes with low frequencies. From this perspective, the trivial solution utilizes different branches for the head, medium, tail classes respectively, and then sums their outputs as the final results is not feasible. Instead, we design the effective residual fusion mechanism with one main branch optimized to recognize images from all classes, another two residual branches are gradually fused and optimized to enhance images from medium tail classes and tail classes respectively. Then the branches are aggregated into final results by additive shortcuts. We test our method on several benchmarks, i.e., long tailed version of CIFAR 10, CIFAR 100, Places, ImageNet, and iNaturalist 2018. Experimental results manifest that our method achieves new state of the art for long tailed recognition. Code will be available at url https github.com FPNAS ResLT .


When FastText Pays Attention Efficient Estimation of Word Representations using Constrained Positional Weighting. In 2018, Mikolov et al. introduced the positional language model, which has characteristics of attention based neural machine translation models and which achieved state of the art performance on the intrinsic word analogy task. However, the positional model is not practically fast and it has never been evaluated on qualitative criteria or extrinsic tasks. We propose a constrained positional model, which adapts the sparse attention mechanism from neural machine translation to improve the speed of the positional model. We evaluate the positional and constrained positional models on three novel qualitative criteria and on language modeling. We show that the positional and constrained positional models contain interpretable information about the grammatical properties of words and outperform other shallow models on language modeling. We also show that our constrained model outperforms the positional model on language modeling and trains twice as fast.


Optimization in Open Networks via Dual Averaging. In networks of autonomous agents (e.g., fleets of vehicles, scattered sensors), the problem of minimizing the sum of the agents' local functions has received a lot of interest. We tackle here this distributed optimization problem in the case of open networks when agents can join and leave the network at any time. Leveraging recent online optimization techniques, we propose and analyze the convergence of a decentralized asynchronous optimization method for open networks.