CMU GPR Dataset Ground Penetrating Radar Dataset for Robot Localization and Mapping. There has been exciting recent progress in using radar as a sensor for robot navigation due to its increased robustness to varying environmental conditions. However, within these different radar perception systems, ground penetrating radar (GPR) remains under explored. By measuring structures beneath the ground, GPR can provide stable features that are less variant to ambient weather, scene, and lighting changes, making it a compelling choice for long term spatio temporal mapping. In this work, we present the CMU GPR dataset an open source ground penetrating radar dataset for research in subsurface aided perception for robot navigation. In total, the dataset contains 15 distinct trajectory sequences in 3 GPS denied, indoor environments. Measurements from a GPR, wheel encoder, RGB camera, and inertial measurement unit were collected with ground truth positions from a robotic total station. In addition to the dataset, we also provide utility code to convert raw GPR data into processed images. This paper describes our recording platform, the data format, utility scripts, and proposed methods for using this data.


Wireless Communication Aided by Intelligent Reflecting Surface Active or Passive?. In this letter, we consider an intelligent reflecting surface (IRS) aided wireless communication system, where an active or passive IRS is employed to assist the communication between an access point and a user. First, we consider the downlink uplink communication separately and optimize the IRS placement for rate maximization with an active or passive IRS. We show that the active IRS should be deployed closer to the receiver with the IRS's decreasing amplification power while in contrast, the passive IRS should be deployed near either the transmitter or receiver. Moreover, with optimized IRS placement, the passive IRS is shown to outperform its active counterpart when the number of reflecting elements is sufficiently large and or the active IRS amplification power is too small. Next, we optimize the IRS placement for both active and passive IRSs to maximize the weighted sum rate of uplink and downlink communications. We show that in this case, the passive IRS is more likely to achieve superior rate performance. This is because the optimal active IRS placement needs to balance the rate performance in the uplink and downlink, while deploying the passive IRS near the transmitter or receiver is optimal regardless of the uplink or downlink.


Pots of Gold at the End of the Rainbow What is Success for Open Source Contributors?. Success in Open Source Software (OSS) is often perceived as an exclusively code centric endeavor. This perception can exclude a variety of individuals with a diverse set of skills and backgrounds, in turn helping create the current diversity inclusion imbalance in OSS. Because people's perspectives of success affect their personal, professional, and life choices, to be able to support a diverse class of individuals, we must first understand what OSS contributors consider successful. Thus far, research has used a uni dimensional, code centric lens to define success. In this paper, we challenge this status quo and reveal the multi faceted definition of success among OSS contributors. We do so through interviews with 27 OSS contributors who are recognized as successful in their communities, and a follow up open survey with 193 OSS contributors. Our study provides nuanced definitions of success perceptions in OSS, which might help devise strategies to attract and retain a diverse set of contributors, helping them attain their "pots of gold at the end of the rainbow".


On the Impact of Device Level Techniques on Energy Efficiency of Neural Network Accelerators. Energy efficiency is a key concern for neural network applications. To alleviate this issue, hardware acceleration using FPGAs or GPUs can provide better energy efficiency than general purpose processors. However, further improvement of the energy efficiency of such accelerators will be extremely beneficial specially to deploy neural network in power constrained edge computing environments. In this paper, we experimentally explore the potential of device level energy efficiency techniques (e.g.,supply voltage underscaling, frequency scaling, and data quantization) for representative off the shelf FPGAs compared to GPUs. Frequency scaling in both platforms can improve the power and energy consumption but with performance overhead, e.g.,in GPUs it improves the power consumption and GOPs J by up to 34 and 28 , respectively. However, leveraging reduced precision instructions improves power (up to 13 ), energy (up to 20 ), and performance (up to 7 ) simultaneously, with negligible reduction in accuracy of neural network accuracy.


Evidences for the existence of the ultimate regime in supergravitational turbulent thermal convection. What is the final state of turbulence when the driving parameter approaches to infinity? For thermal turbulence, in 1962, Kraichnan proposed a so called ultimate scaling dependence of the heat transport (quantified by the Nusselt number text Nu ) on the Rayleigh number ( text Ra ), which can be extrapolated to arbitrarily high text Ra . The existence of Kraichnan ultimate scaling has been intensively debated in the past decades. In this work, using a supergravitational thermal convection system, with an effective gravity up to 100 times the Earth's gravity, both Rayleigh number and shear Reynolds number can be boosted due to the increase of the buoyancy driving and the additional Coriolis forces. Over a decade of text Ra range, we demonstrate the existence of Kraichnan like ultimate regime with four direct evidences the ultimate scaling dependence of text Nu versus text Ra the appearance of turbulent velocity boundary layer profile the enhanced strength of the shear Reynolds number the new statistical properties of local temperature fluctuations. The present findings will greatly improve the understanding of the flow dynamics in geophysical and astrophysical flows.


SODA10M A Large Scale 2D Self Semi Supervised Object Detection Dataset for Autonomous Driving. Aiming at facilitating a real world, ever evolving and scalable autonomous driving system, we present a large scale dataset for standardizing the evaluation of different self supervised and semi supervised approaches by learning from raw data, which is the first and largest dataset to date. Existing autonomous driving systems heavily rely on perfect' visual perception models (i.e., detection) trained using extensive annotated data to ensure safety. However, it is unrealistic to elaborately label instances of all scenarios and circumstances (i.e., night, extreme weather, cities) when deploying a robust autonomous driving system. Motivated by recent advances of self supervised and semi supervised learning, a promising direction is to learn a robust detection model by collaboratively exploiting large scale unlabeled data and few labeled data. Existing datasets either provide only a small amount of data or covers limited domains with full annotation, hindering the exploration of large scale pre trained models. Here, we release a Large Scale 2D Self semi supervised Object Detection dataset for Autonomous driving, named as SODA10M, containing 10 million unlabeled images and 20K images labeled with 6 representative object categories. To improve diversity, the images are collected within 27833 driving hours under different weather conditions, periods and location scenes of 32 different cities. We provide extensive experiments and deep analyses of existing popular self semi supervised approaches, and give some interesting findings in autonomous driving scope. Experiments show that SODA10M can serve as a promising pre training dataset for different self supervised learning methods, which gives superior performance when fine tuning with different downstream tasks (i.e., detection, semantic instance segmentation) in autonomous driving domain. More information can refer to https soda 2d.github.io.


Including Keyword Position in Image based Models for Act Segmentation of Historical Registers. The segmentation of complex images into semantic regions has seen a growing interest these last years with the advent of Deep Learning. Until recently, most existing methods for Historical Document Analysis focused on the visual appearance of documents, ignoring the rich information that textual content can offer. However, the segmentation of complex documents into semantic regions is sometimes impossible relying only on visual features and recent models embed both visual and textual information. In this paper, we focus on the use of both visual and textual information for segmenting historical registers into structured and meaningful units such as acts. An act is a text recording containing valuable knowledge such as demographic information (baptism, marriage or death) or royal decisions (donation or pardon). We propose a simple pipeline to enrich document images with the position of text lines containing key phrases and show that running a standard image based layout analysis system on these images can lead to significant gains. Our experiments show that the detection of acts increases from 38 of mAP to 74 when adding textual information, in real use case conditions where text lines positions and content are extracted with an automatic recognition system.


Morita equivalence for operator systems. We define Delta equivalence for operator systems and show that it is identical to stable isomorphism. We define Delta contexts and bihomomorphism contexts and show that two operator systems are Delta equivalent if and only if they can be placed in a Delta context, equivalently, in a bihomomorphism context. We show that nuclearity for a variety of tensor products is an invariant for Delta equivalence and that function systems are Delta equivalent precisely when they are order isomorphic. We prove that Delta equivalent operator systems have equivalent categories of representations. As an application, we characterise Delta equivalence of graph operator systems in combinatorial terms. We examine a notion of Morita embedding for operator systems, showing that mutually Delta embeddable operator systems have orthogonally complemented Delta equivalent corners.


Stochastic energy balance climate models with Legendre weighted diffusion and a cylindrical Wiener process forcing. We consider a class of one dimensional nonlinear stochastic parabolic problems associated with Sellers and Budyko diffusive energy balance climate models with a Legendre weighted diffusion and an additive cylindrical Wiener processes forcing. Our results use in an important way that, under suitable assumptions on the Wiener processes, a suitable change of variables leads the problem to a pathwise random PDE, hence an essentially "deterministic" formulation depending on a random parameter. Two applications are also given the stability of solutions when the Wiener process converges to zero and the asymptotic behaviour of solutions for large time.


Spatial Sensitivity of ECG Electrode Placement. The electrocardiogram (ECG) is a well known technique used to diagnose cardiac diseases. To acquire the spatial signal characteristics from the thorax, multiple electrodes are commonly used. Displacements of electrodes affect the signal morphologies and can lead to incorrect diagnoses. For quantitative analysis of these effects we propose the usage of a numerical computer simulation. In order to create a realistic representation of the human thorax including the heart and lung a three dimensional model with a simplified geometry is used. The electrical excitation of the heart is modelled on a cellular level via the bidomain approach. To numerically solve the differential equations, describing the signal propagation within the body, we use the finite element method in COMSOL Multiphysics. The spatial gradients of the simulated body potentials are calculated to determine placement sensitivity maps. The simulated results show that the sensitivity is different for each considered point in time of each ECG wave. In general, the impact of displacement is increased as an electrode is more closely located to the signal source. However, in some specific regions associated with differential ECG leads the placement sensitivity distribution deviates from this simple circular pattern. The results provide useful information to enhance the understanding of placed specific effects on classical ECG features. By additional consideration of patient specific characteristics in the future, the used model has the ability to investigate additional body related aspects such as geometrical body shape or composition of various tissue types.


Edge Clique Covers in Graphs with Independence Number Two a Special Case. The edge clique cover number ecc(G) of a graph G is the size of the smallest set of complete subgraphs whose union covers all edges of G . It has been conjectured that all the simple graphs with independence number two satisfy ecc(G) leq n . First, we present a class of graphs containing edges difficult to cover but that satisfy the conjecture. Second, we describe a large class of graphs G such that ecc(G) leq frac 3 2 n . This class is easy to characterize.


JUMBO Scalable Multi task Bayesian Optimization using Offline Data. The goal of Multi task Bayesian Optimization (MBO) is to minimize the number of queries required to accurately optimize a target black box function, given access to offline evaluations of other auxiliary functions. When offline datasets are large, the scalability of prior approaches comes at the expense of expressivity and inference quality. We propose JUMBO, an MBO algorithm that sidesteps these limitations by querying additional data based on a combination of acquisition signals derived from training two Gaussian Processes (GP) a cold GP operating directly in the input domain and a warm GP that operates in the feature space of a deep neural network pretrained using the offline data. Such a decomposition can dynamically control the reliability of information derived from the online and offline data and the use of pretrained neural networks permits scalability to large offline datasets. Theoretically, we derive regret bounds for JUMBO and show that it achieves no regret under conditions analogous to GP UCB (Srinivas et. al. 2010). Empirically, we demonstrate significant performance improvements over existing approaches on two real world optimization problems hyper parameter optimization and automated circuit design.


A Rational Entailment for Expressive Description Logics via Description Logic Programs. Lehmann and Magidor's rational closure is acknowledged as a landmark in the field of non monotonic logics and it has also been re formulated in the context of Description Logics (DLs). We show here how to model a rational form of entailment for expressive DLs, such as SROIQ, providing a novel reasoning procedure that compiles a non monotone DL knowledge base into a description logic program (dl program).


Tight Bounds on the Optimal UL Sum Rate of MU RIS aided Wireless Systems. The objective of this paper is to develop simple techniques to bound the optimal uplink sum rate of multi user RIS aided wireless systems. Specifically, we develop a novel technique called textit channel separation which provides a new understanding as to how the RIS phases affect the sum rate. Leveraging channel separation, we derive upper and lower bounds on the optimal sum rate. In addition, we propose a low complexity alternating optimization algorithm to obtain near optimal sum rate results. Numerical results demonstrate the tightness of the bounds and show that the alternating optimization approach delivers sum rate values similar to the results of a full numerical optimization procedure. Furthermore, in practical scenarios where hardware limitations cause the RIS phases to be quantized, our lower bound can still be applied and shows that the sum rate is robust to quantization, even with low resolution.


Unbounded Pontryagin numbers on nonnegatively curved spin manifolds. We prove that any rational linear combination of Pontryagin numbers that does not factor through the universal elliptic genus is unbounded on connected closed spin manifolds of nonnegative sectional curvature.


Decision Making under On Ramp merge Scenarios by Distributional Soft Actor Critic Algorithm. Merging into the highway from the on ramp is an essential scenario for automated driving. The decision making under the scenario needs to balance the safety and efficiency performance to optimize a long term objective, which is challenging due to the dynamic, stochastic, and adversarial characteristics. The Rule based methods often lead to conservative driving on this task while the learning based methods have difficulties meeting the safety requirements. In this paper, we propose an RL based end to end decision making method under a framework of offline training and online correction, called the Shielded Distributional Soft Actor critic (SDSAC). The SDSAC adopts the policy evaluation with safety consideration and a safety shield parameterized with the barrier function in its offline training and online correction, respectively. These two measures support each other for better safety while not damaging the efficiency performance severely. We verify the SDSAC on an on ramp merge scenario in simulation. The results show that the SDSAC has the best safety performance compared to baseline algorithms and achieves efficient driving simultaneously.


A Theory of Consciousness from a Theoretical Computer Science Perspective Insights from the Conscious Turing Machine. The quest to understand consciousness, once the purview of philosophers and theologians, is now actively pursued by scientists of many stripes. We examine consciousness from the perspective of theoretical computer science (TCS), a branch of mathematics concerned with understanding the underlying principles of computation and complexity, including the implications and surprising consequences of resource limitations. In the spirit of Alan Turing's simple yet powerful definition of a computer, the Turing Machine (TM), and perspective of computational complexity theory, we formalize a modified version of the Global Workspace Theory (GWT) of consciousness originated by cognitive neuroscientist Bernard Baars and further developed by him, Stanislas Dehaene, Jean Pierre Changeaux and others. We are not looking for a complex model of the brain nor of cognition, but for a simple computational model of (the admittedly complex concept of) consciousness. We do this by defining the Conscious Turing Machine (CTM), also called a conscious AI, and then we define consciousness and related notions in the CTM. While these are only mathematical (TCS) definitions, we suggest why the CTM has the feeling of consciousness. The TCS perspective provides a simple formal framework to employ tools from computational complexity theory and machine learning to help us understand consciousness and related concepts. Previously we explored high level explanations for the feelings of pain and pleasure in the CTM. Here we consider three examples related to vision (blindsight, inattentional blindness, and change blindness), followed by discussions of dreams, free will, and altered states of consciousness.


Control Strategies for Transport Networks under Demand Uncertainty. In this article, we consider transport networks with uncertain demands. Network dynamics are given by linear hyperbolic partial differential equations and suitable coupling conditions, while demands are incorporated as solutions to stochastic differential equations. For the demand satisfaction, we solve a constrained optimal control problem. Controls in terms of network inputs are then calculated explicitly for different assumptions. Numerical simulations are performed to underline the theoretical results.


On a conjecture of Coleman concerning Euler systems. We prove a distribution theoretic conjecture of Robert Coleman, thereby also obtaining an explicit description of the complete set of Euler systems for the multiplicative group over Q.


Minimization of magnetic forces on Stellarator coils. Magnetic confinement devices for nuclear fusion can be large and expensive. Compact stellarators are promising candidates for costreduction, but introduce new difficulties confinement in smaller volumes requires higher magnetic field, which calls for higher coil currents and ultimately causes higher Laplace forces on the coils if everything else remains the same. This motivates the inclusion of force reduction in stellarator coil optimization. In the present paper we consider a coil winding surface, we prove that there is a natural and rigorous way to define the Laplace force (despite the magnetic field discontinuity across the current sheet), we provide examples of cost associated (peak force, surface integral of the force squared) and discuss easy generalizations to parallel and normal force components, as these will be subject to different engineering constraints. Such costs can then be easily added to the figure of merit in any multi objective stellarator coil optimization code. We demonstrate this for a generalization of the REGCOIL code 1 , which we rewrote in python, and provide numerical examples for the NCSX (now QUASAR) design. We present results for various definitions of the cost function, including peak force reductions by up to 40 , and outline future work for further reduction.


Polyline Based Generative Navigable Space Segmentation for Autonomous Visual Navigation. Detecting navigable space is a fundamental capability for mobile robots navigating in unknown or unmapped environments. In this work, we treat the visual navigable space segmentation as a scene decomposition problem and propose Polyline Segmentation Variational AutoEncoder Networks (PSV Nets), a representation learning based framework to enable robots to learn the navigable space segmentation in an unsupervised manner. Current segmentation techniques heavily rely on supervised learning strategies which demand a large amount of pixel level annotated images. In contrast, the proposed framework leverages a generative model Variational AutoEncoder (VAE) and an AutoEncoder (AE) to learn a polyline representation that compactly outlines the desired navigable space boundary in an unsupervised way. We also propose a visual receding horizon planning method that uses the learned navigable space and a Scaled Euclidean Distance Field (SEDF) to achieve autonomous navigation without an explicit map. Through extensive experiments, we have validated that the proposed PSV Nets can learn the visual navigable space with high accuracy, even without any single label. We also show that the prediction of the PSV Nets can be further improved with a small number of labels (if available) and can significantly outperform the state of the art fully supervised learning based segmentation methods.


SA Net Shuffle Attention for Deep Convolutional Neural Networks. Attention mechanisms, which enable a neural network to accurately focus on all the relevant elements of the input, have become an essential component to improve the performance of deep neural networks. There are mainly two attention mechanisms widely used in computer vision studies, textit spatial attention and textit channel attention , which aim to capture the pixel level pairwise relationship and channel dependency, respectively. Although fusing them together may achieve better performance than their individual implementations, it will inevitably increase the computational overhead. In this paper, we propose an efficient Shuffle Attention (SA) module to address this issue, which adopts Shuffle Units to combine two types of attention mechanisms effectively. Specifically, SA first groups channel dimensions into multiple sub features before processing them in parallel. Then, for each sub feature, SA utilizes a Shuffle Unit to depict feature dependencies in both spatial and channel dimensions. After that, all sub features are aggregated and a "channel shuffle" operator is adopted to enable information communication between different sub features. The proposed SA module is efficient yet effective, e.g., the parameters and computations of SA against the backbone ResNet50 are 300 vs. 25.56M and 2.76e 3 GFLOPs vs. 4.12 GFLOPs, respectively, and the performance boost is more than 1.34 in terms of Top 1 accuracy. Extensive experimental results on common used benchmarks, including ImageNet 1k for classification, MS COCO for object detection, and instance segmentation, demonstrate that the proposed SA outperforms the current SOTA methods significantly by achieving higher accuracy while having lower model complexity. The code and models are available at https github.com wofmanaf SA Net.


Time and Memory Efficient Parallel Algorithm for Structural Graph Summaries and two Extensions to Incremental Summarization and k Bisimulation for Long k Chaining. We developed a flexible parallel algorithm for graph summarization based on vertex centric programming and parameterized message passing. The base algorithm supports infinitely many structural graph summary models defined in a formal language. An extension of the parallel base algorithm allows incremental graph summarization. In this paper, we prove that the incremental algorithm is correct and show that updates are performed in time mathcal O ( Delta cdot d k) , where Delta is the number of additions, deletions, and modifications to the input graph, d the maximum degree, and k is the maximum distance in the subgraphs considered. Although the iterative algorithm supports values of k 1 , it requires nested data structures for the message passing that are memory inefficient. Thus, we extended the base summarization algorithm by a hash based messaging mechanism to support a scalable iterative computation of graph summarizations based on k bisimulation for arbitrary k . We empirically evaluate the performance of our algorithms using benchmark and real world datasets. The incremental algorithm almost always outperforms the batch computation. We observe in our experiments that the incremental algorithm is faster even in cases when 50 of the graph database changes from one version to the next. The incremental computation requires a three layered hash index, which has a low memory overhead of only 8 ( pm 1 ). Finally, the incremental summarization algorithm outperforms the batch algorithm even with fewer cores. The iterative parallel k bisimulation algorithm computes summaries on graphs with over 10 M edges within seconds. We show that the algorithm processes graphs of 100 , M edges within a few minutes while having a moderate memory consumption of 150 GB. For the largest BSBM1B dataset with 1 billion edges, it computes k 10 bisimulation in under an hour.


Super rewriting theory and nondegeneracy of odd categorified sl(2). We develop the rewriting theory for monoidal supercategories and 2 supercategories. This extends the theory of higher dimensional rewriting established for (linear) 2 categories to the super setting, providing a suite of tools for constructing bases and normal forms for 2 supercategories given by generators and relations. We then employ this newly developed theory to prove the non degeneracy conjecture for the odd categorification of quantum sl(2) from arXiv 1307.7816 and arXiv 1701.04133. As a corollary, this gives a classification of dg structures on the odd 2 category conjectured in arXiv 1808.04924.


Unraveling the Hidden Environmental Impacts of AI Solutions for Environment. In the past ten years, artificial intelligence has encountered such dramatic progress that it is now seen as a tool of choice to solve environmental issues and in the first place greenhouse gas emissions (GHG). At the same time the deep learning community began to realize that training models with more and more parameters requires a lot of energy and as a consequence GHG emissions. To our knowledge, questioning the complete net environmental impacts of AI solutions for the environment (AI for Green), and not only GHG, has never been addressed directly. In this article, we propose to study the possible negative impacts of AI for Green. First, we review the different types of AI impacts, then we present the different methodologies used to assess those impacts, and show how to apply life cycle assessment to AI services. Finally, we discuss how to assess the environmental usefulness of a general AI service, and point out the limitations of existing work in AI for Green.


Scheduling of Graph Queries Controlling Intra and Inter query Parallelism for a High System Throughput. The vast amounts of data used in social, business or traffic networks, biology and other natural sciences are often managed in graph based data sets, consisting of a few thousand up to billions and trillions of vertices and edges, respectively. Typical applications utilizing such data either execute one or a few complex queries or many small queries at the same time interactively or as batch jobs. Furthermore, graph processing is inherently complex, as data sets can substantially differ (scale free vs. constant degree), and algorithms exhibit diverse behavior (computational intensity, local or global, push or pull based). This work is concerned with multi query execution by automatically controlling the degree of parallelization, with overall objectives including high system utilization, low synchronization cost, and highly efficient concurrent execution. The underlying concept is three fold (1) sampling is used to determine graph statistics, (2) parallelization constraints are derived from algorithm and system properties, and (3) suitable work packages are generated based on the previous two aspects. We evaluate the proposed concept using different algorithms on synthetic and real world data sets, with up to 16 concurrent sessions (queries). The results demonstrate a robust performance in spite of these various configurations, and in particular that the performance is always close to or even slightly ahead of the performance of manually optimized implementations. Furthermore, the similar performance to manually optimized implementations under extreme configurations, which require either a full parallelization (few large queries) or complete sequential execution (many small queries), shows that the proposed concept exhibits a particularly low overhead.


Event Aware Multimodal Mobility Nowcasting. As a decisive part in the success of Mobility as a Service (MaaS), spatio temporal predictive modeling for crowd movements is a challenging task particularly considering scenarios where societal events drive mobility behavior deviated from the normality. While tremendous progress has been made to model high level spatio temporal regularities with deep learning, most, if not all of the existing methods are neither aware of the dynamic interactions among multiple transport modes nor adaptive to unprecedented volatility brought by potential societal events. In this paper, we are therefore motivated to improve the canonical spatio temporal network (ST Net) from two perspectives (1) design a heterogeneous mobility information network (HMIN) to explicitly represent intermodality in multimodal mobility (2) propose a memory augmented dynamic filter generator (MDFG) to generate sequence specific parameters in an on the fly fashion for various scenarios. The enhanced event aware spatio temporal network, namely EAST Net, is evaluated on several real world datasets with a wide variety and coverage of societal events. Both quantitative and qualitative experimental results verify the superiority of our approach compared with the state of the art baselines. Code and data are published on https github.com underdoc wang EAST Net.


Existence of gradient Gibbs measures on regular trees which are not translation invariant. We provide an existence theory for gradient Gibbs measures for Z valued spin models on regular trees which are not invariant under translations of the tree, assuming only summability of the transfer operator. The gradient states we obtain are delocalized. The construction we provide for them starts from a two layer hidden Markov model representation in a setup which is not invariant under tree automorphisms, involving internal q spin models. The proofs of existence and lack of translation invariance of infinite volume gradient states are based on properties of the local pseudo unstable manifold of the corresponding discrete dynamical systems of these internal models, around the free state, at large q.


Optimized Implementation for Calculation and Fast Update of Pfaffians Installed to the Open Source Fermionic Variational Solver mVMC. In this article, we present a high performance, portable and well templated implementation for computing and fast updating Pfaffian and inverse of an even ranked skew symmetric (antisymmetric) matrix. It is achieved with a skew symmetric, blocked variant of the Parlett Reid algorithm and a blocked update scheme based on the Woodbury matrix identity. Installation of this framework into the geminal wavefunction based many variable Variational Monte Carlo (mVMC) code boosts sampling performance to up to more than 6 times without changing Markov chain's behavior. The implementation is based on an extension of the BLAS like instantiation software (BLIS) framework which has optimized kernel for many state of the art processors including Intel Skylake X, AMD EPYC Rome and Fujitsu A64FX.


Self dual Artin representations of dimension three (with an appendix by David E. Rohrlich). We give an unconditional proof that self dual Artin representations of mathbb Q of dimension 3 have density 0 among all Artin representations of mathbb Q of dimension 3 . Previously this was known under the assumption of Malle's Conjecture.


A 4 DoF Parallel Origami Haptic Device for Normal, Shear, and Torsion Feedback. We present a mesoscale finger mounted 4 degree of freedom (DoF) haptic device that is created using origami fabrication techniques. The 4 DoF device is a parallel kinematic mechanism capable of delivering normal, shear, and torsional haptic feedback to the fingertip. Traditional methods of robot fabrication are not well suited for designing small robotic devices because it is challenging and expensive to manufacture small, low friction joints. Our device uses origami manufacturing principles to reduce complexity and the device footprint. We characterize the bandwidth, workspace, and force output of the device. The capabilities of the torsion DoF are demonstrated in a virtual reality scenario. Our results show that the device can deliver haptic feedback in 4 DoFs with an effective operational workspace of 0.64cm 3 with pm 30 circ rotation at every location. The maximum forces and torques the device can apply in the x , y , z , and theta directions, are pm 1.5N, pm 1.5N, 2N, and 5N cdot mm, respectively, and the device has an operating bandwidth of 9Hz.


S ojiTantei Function Call Reachability Detection of Vulnerable Code for npm Packages. It has become common practice for software projects to adopt third party dependencies. Developers are encouraged to update any outdated dependency to remain safe from potential threats of vulnerabilities. In this study, we present an approach to aid developers show whether or not a vulnerable code is reachable for JavaScript projects. Our prototype, S ojiTantei, is evaluated in two ways (i) the accuracy when compared to a manual approach and (ii) a larger scale analysis of 780 clients from 78 security vulnerability cases. The first evaluation shows that S ojiTantei has a high accuracy of 83.3 , with a speed of less than a second analysis per client. The second evaluation reveals that 68 out of the studied 78 vulnerabilities reported having at least one clean client. The study proves that automation is promising with the potential for further improvement.


Neurons learn slower than they think. Recent studies revealed complex convergence dynamics in gradient based methods, which has been little understood so far. Changing the step size to balance between high convergence rate and small generalization error may not be sufficient maximizing the test accuracy usually requires a larger learning rate than minimizing the training loss. To explore the dynamic bounds of convergence rate, this study introduces textit differential capability into an optimization process, which measures whether the test accuracy increases as fast as a model approaches the decision boundary in a classification problem. The convergence analysis showed that 1) a higher convergence rate leads to slower capability growth 2) a lower convergence rate results in faster capability growth and decay 3) regulating a convergence rate in either direction reduces differential capability.


On the Second order Convergence Properties of Random Search Methods. We study the theoretical convergence properties of random search methods when optimizing non convex objective functions without having access to derivatives. We prove that standard random search methods that do not rely on second order information converge to a second order stationary point. However, they suffer from an exponential complexity in terms of the input dimension of the problem. In order to address this issue, we propose a novel variant of random search that exploits negative curvature by only relying on function evaluations. We prove that this approach converges to a second order stationary point at a much faster rate than vanilla methods namely, the complexity in terms of the number of function evaluations is only linear in the problem dimension. We test our algorithm empirically and find good agreements with our theoretical results.


CAMA Energy and Memory Efficient Automata Processing in Content Addressable Memories. Accelerating finite automata processing is critical for advancing real time analytic in pattern matching, data mining, bioinformatics, intrusion detection, and machine learning. Recent in memory automata accelerators leveraging SRAMs and DRAMs have shown exciting improvements over conventional digital designs. However, the bit vector representation of state transitions used by all SOTA designs is only optimal in processing worst case completely random patterns, while a significant amount of memory and energy is wasted in running most real world benchmarks. We present CAMA, a Content Addressable Memory (CAM) enabled Automata accelerator for processing homogeneous non deterministic finite automata (NFA). A radically different state representation scheme, along with co designed novel circuits and data encoding schemes, greatly reduces energy, memory, and chip area for most realistic NFAs. CAMA is holistically optimized with the following major contributions (1) a 16x256 8 transistor (8T) CAM array for state matching, replacing the 256x256 6T SRAM array or two 16x256 6T SRAM banks in SOTA designs (2) a novel encoding scheme that enables content searching within 8T SRAMs and adapts to different applications (3) a reconfigurable and scalable architecture that improves efficiency on all tested benchmarks, without losing support for any NFA that is compatible with SOTA designs (4) an optimization framework that automates the choice of encoding schemes and maps a given NFA to the proposed hardware. Two versions of CAMA, one optimized for energy (CAMA E) and the other for throughput (CAMA T), are comprehensively evaluated in a 28nm CMOS process, and across 21 real world and synthetic benchmarks. CAMA E achieves 2.1x, 2.8x, and 2.04x lower energy than CA, 2 stride Impala, and eAP. CAMA T shows 2.68x, 3.87x and 2.62x higher average compute density than 2 stride Impala, CA, and eAP.


Agent based model and data assimilation Analysis of COVID 19 in Tokyo. In this paper we introduce an agent based model together with a particle filter approach for studying the spread of COVID 19. Investigations are performed on the metropolis of Tokyo, but other cities, regions or countries could have been equally chosen. A novel method for evaluating the effective reproduction number is one of the main outcome of our approach. Other unknown parameters and unknown populations are also evaluated. Uncertain quantities, as for example the ratio of symptomatic asymptomatic agents, are tested and discussed, and the stability of our computations is examined. Detailed explanations are provided for the model and for the assimilation process.


Accelerated Sim to Real Deep Reinforcement Learning Learning Collision Avoidance from Human Player. This paper presents a sensor level mapless collision avoidance algorithm for use in mobile robots that map raw sensor data to linear and angular velocities and navigate in an unknown environment without a map. An efficient training strategy is proposed to allow a robot to learn from both human experience data and self exploratory data. A game format simulation framework is designed to allow the human player to tele operate the mobile robot to a goal and human action is also scored using the reward function. Both human player data and self playing data are sampled using prioritized experience replay algorithm. The proposed algorithm and training strategy have been evaluated in two different experimental configurations textit Environment 1 , a simulated cluttered environment, and textit Environment 2 , a simulated corridor environment, to investigate the performance. It was demonstrated that the proposed method achieved the same level of reward using only 16 of the training steps required by the standard Deep Deterministic Policy Gradient (DDPG) method in Environment 1 and 20 of that in Environment 2. In the evaluation of 20 random missions, the proposed method achieved no collision in less than 2 h and 2.5 h of training time in the two Gazebo environments respectively. The method also generated smoother trajectories than DDPG. The proposed method has also been implemented on a real robot in the real world environment for performance evaluation. We can confirm that the trained model with the simulation software can be directly applied into the real world scenario without further fine tuning, further demonstrating its higher robustness than DDPG. The video and code are available https youtu.be BmwxevgsdGc https github.com hanlinniu turtlebot3 ddpg collision avoidance


Numerical predictions of shear stress and cyclic stretch in the healthy pulmonary vasculature. Isolated post capillary pulmonary hypertension (Ipc PH) occurs due to left heart failure, which contributes to 1 out of every 9 deaths in the United States. In some patients, through unknown mechanisms, Ipc PH transitions to combined pre post capillary PH (Cpc PH), diagnosed by an increase in pulmonary vascular resistance and associated with a dramatic increase in mortality. We hypothesize that altered mechanical forces and subsequent vasoactive signaling in the pulmonary capillary bed drive the transition from Ipc PH to Cpc PH. However, even in a healthy pulmonary circulation, the mechanical forces in the smallest vessels (the arterioles, venules, and capillary bed) have not been quantitatively defined. This study is the first to examine this question via a computational fluid dynamics model of the human pulmonary arteries, veins, arterioles, and venules. Using this model we predict temporal and spatial dynamics of cyclic stretch and wall shear stress. In the large vessels, numerical simulations show that shear stress increases coincides with larger flow and pressure. In the microvasculature, we found that as vessel radius decreases, shear stress increases and flow decreases. In arterioles, this corresponds with lower pressures however, the venules and smaller veins have higher pressure than larger veins. Our model provides predictions for pressure, flow, shear stress, and cyclic stretch that provides a way to analyze and investigate hypotheses related to disease progression in the pulmonary circulation.


Two fluid modeling of heat transfer in flows of dense suspensions. We develop a two fluid model (TFM) for heat transfer in dense non Brownian suspensions. Specifically, we propose closure relations for the inter phase heat transfer coefficient and the thermal diffusivity of the particle phase based on calibration against experimental data. The model is then employed to simulate non isothermal flow in an annular Couette cell. We find that, when the shear rate is controlled by the rotation of the inner cylinder, both the shear and thermal gradients are responsible for particle migration. Within the TFM framework, we identify the origin and functional form of a "thermo rheological" migration force that rationalizes our observations. Furthermore, we apply our model to flow in eccentric Couette cells. Our simulations reveal that the system's heat transfer coefficient is affected by both the classic shear induced migration of particles and the newly identified thermo rheological migration effect.


Characterization of the Gittins index for sequential multistage jobs. The optimal scheduling problem in single server queueing systems is a classic problem in queueing theory. The Gittins index policy is known to be the optimal preemptive nonanticipating policy (both for the open version of the problem with Poisson arrivals and the closed version without arrivals) minimizing the expected holding costs. While the Gittins index is thoroughly characterized for ordinary jobs whose state is described by the attained service, it is not at all the case with jobs that have more complex structure. Recently, a class of such jobs, the multistage jobs, were introduced, and it was shown that the computation of Gittins index of a multistage job reduces into separable computations for the individual stages. The characterization is, however, indirect in the sense that it relies on the recursion for an auxiliary function (so called SJP function) and not for the Gittins index itself. In this paper, we answer the natural question Is it possible to compute the Gittins index for a multistage job more directly by recursively combining the Gittins indexes of its individual stages? According to our results, it seems to be possible, at least, for sequential multistage jobs that have a fixed (deterministic) sequence of stages. We prove this for sequential two stage jobs that have monotonous hazard rates in both stages, but our numerical experiments give an indication that the result could possibly be generalized to any sequential multistage jobs. Our approach, in this paper, is based on the Whittle index originally developed in the context of restless bandits.


Estimation of Spatially Correlated Ocean Currents from Ensemble Forecasts and Online Measurements. We present a method to estimate two dimensional, time invariant oceanic flow fields based on data from both ensemble forecasts and online measurements. Our method produces a realistic estimate in a computationally efficient manner suitable for use in marine robotics for path planning and related applications. We use kernel methods and singular value decomposition to find a compact model of the ensemble data that is represented as a linear combination of basis flow fields and that preserves the spatial correlations present in the data. Online measurements of ocean current, taken for example by marine robots, can then be incorporated using recursive Bayesian estimation. We provide computational analysis, performance comparisons with related methods, and demonstration with real world ensemble data to show the computational efficiency and validity of our method. Possible applications in addition to path planning include active perception for model improvement through deliberate choice of measurement locations.


Finding Relevant Points for Nearest Neighbor Classification. In nearest neighbor classification problems, a set of d dimensional training points are given, each with a known classification, and are used to infer unknown classifications of other points by using the same classification as the nearest training point. A training point is relevant if its omission from the training set would change the outcome of some of these inferences. We provide a simple algorithm for thinning a training set down to its subset of relevant points, using as subroutines algorithms for finding the minimum spanning tree of a set of points and for finding the extreme points (convex hull vertices) of a set of points. The time bounds for our algorithm, in any constant dimension d ge 3 , improve on a previous algorithm for the same problem by Clarkson (FOCS 1994).


GSM GPRS Based Smart Street Light. Street lighting system has always been the traditional manual system of illuminating the streets in Bangladesh, where a dedicated person is posted only to control the street lights of a zone, who roams around the zonal area to switch on and switch off the lights two times a day, which brings about the exhibition of bright lights in street even after sunrise and in some cases maybe the whole day. This results in insertion to the budget. In addition to this, faulty lights may not come to the heed of the concerned authority for a long time which leads to the technical downside. This paper demonstrates a process of controlling the street lights in country like Bangladesh employing SIM900 GSM GPRS Shield which comes up with the provision of manual control, semi automated control as well as full automated control.


The Bonnet theorem for statistical manifolds. We prove the Bonnet theorem for statistical manifolds, which states that if a statistical manifold admits tensors satisfying the Gauss Codazzi Ricci equations, then it is locally embeddable to a flat statistical manifold (or a Hessian manifold). The proof is based on the notion of statistical embedding to the product of a vector space and its dual space introduced by Lauritzen. As another application of Lauritzen's embedding, we show that a statistical manifold admitting an affine embedding of codimension 1 or 2 is locally embeddable to a flat statistical manifold of the same codimension.


Generalized theory of spatial coherence for superposition of two speckle patterns with polarization diversity. A generalized theory of spatial coherence for superposition of two speckle patterns with polarization diversity is presented. The presented theory deals with superposition in different scenarios i.e. superposition of two fully correlated, partially correlated and completely uncorrelated speckle patterns, and describes the effect on the spatial coherence polarization (CP) property of the superposed random field from the study of the spatial degree of coherence and degree of polarization. The change in the spatial CP property with the polarization diversity is studied for different correlation factors of the constituent random fields, and a modulation of the spatial CP property is observed, when the constituent speckle patterns are not fully correlated. The effect of the average intensity ratio of the two random fields on the spatial CP property is also studied. Thus, this theoretical study completes the case of superposition of two speckle patterns with polarization diversity and its effect on the spatial CP property.


Presentations of projective quantum groups. Given an orthogonal compact matrix quantum group defined by intertwiner relations, we characterize by relations its projective version. As a sample application, we prove that PU n PO n . We also give a combinatorial proof of the fact that S n 2 is monoidally equivalent to PO n .


Graph Based Intercategory and Intermodality Network for Multilabel Classification and Melanoma Diagnosis of Skin Lesions in Dermoscopy and Clinical Images. The identification of melanoma involves an integrated analysis of skin lesion images acquired using the clinical and dermoscopy modalities. Dermoscopic images provide a detailed view of the subsurface visual structures that supplement the macroscopic clinical images. Melanoma diagnosis is commonly based on the 7 point visual category checklist (7PC). The 7PC contains intrinsic relationships between categories that can aid classification, such as shared features, correlations, and the contributions of categories towards diagnosis. Manual classification is subjective and prone to intra and interobserver variability. This presents an opportunity for automated methods to improve diagnosis. Current state of the art methods focus on a single image modality and ignore information from the other, or do not fully leverage the complementary information from both modalities. Further, there is not a method to exploit the intercategory relationships in the 7PC. In this study, we address these issues by proposing a graph based intercategory and intermodality network (GIIN) with two modules. A graph based relational module (GRM) leverages intercategorical relations, intermodal relations, and prioritises the visual structure details from dermoscopy by encoding category representations in a graph network. The category embedding learning module (CELM) captures representations that are specialised for each category and support the GRM. We show that our modules are effective at enhancing classification performance using a public dataset of dermoscopy clinical images, and show that our method outperforms the state of the art at classifying the 7PC categories and diagnosis.


Video Super Resolution Transformer. Video super resolution (VSR), with the aim to restore a high resolution video from its corresponding low resolution version, is a spatial temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its parallel computing ability for sequence to sequence modeling. Thus, it seems to be straightforward to apply the vision Transformer to solve VSR. However, the typical block design of Transformer with a fully connected self attention layer and a token wise feed forward layer does not fit well for VSR due to the following two reasons. First, the fully connected self attention layer neglects to exploit the data locality because this layer relies on linear layers to compute attention maps. Second, the token wise feed forward layer lacks the feature alignment which is important for VSR since this layer independently processes each of the input token embeddings without any interaction among them. In this paper, we make the first attempt to adapt Transformer for VSR. Specifically, to tackle the first issue, we present a spatial temporal convolutional self attention layer with a theoretical understanding to exploit the locality information. For the second issue, we design a bidirectional optical flow based feed forward layer to discover the correlations across different video frames and also align features. Extensive experiments on several benchmark datasets demonstrate the effectiveness of our proposed method. The code will be available at https github.com caojiezhang VSR Transformer.


1 Low power continuous wave nonlinear optics in silica glass integrated waveguide structures. Photonic integrated circuits (PICs) are a key component 1 for future telecommunication networks, where demands for greater bandwidth, network flexibility, low energy consumption and cost must all be met. The quest for all optical components has naturally targeted materials with extremely large nonlinearity, including chalcogenide glasses (ChG) 2 and semiconductors, such as silicon 3 and AlGaAs 4 . Yet issues such as immature fabrication technologies for ChG, and high linear and nonlinear losses for semiconductors, motivate the search for other materials. Here we present the first demonstration of nonlinear optics in integrated silica based glass waveguides using continuous wave (CW) light. We demonstrate four wave mixing (FWM), with low (7mW) CW pump power at a wavelength of 1550nm, in high index doped silica glass ring resonators capable of performing in photonic telecommunications networks as linear filters 5 . The high reliability, design flexibility, and manufacturability of our device raises the possibility of a new platform for future low cost nonlinear all optical PICs.


Scaling Up Vision Language Pre training for Image Captioning. In recent years, we have witnessed significant performance boost in the image captioning task based on vision language pre training (VLP). Scale is believed to be an important factor for this advance. However, most existing work only focuses on pre training transformers with moderate sizes (e.g., 12 or 24 layers) on roughly 4 million images. In this paper, we present LEMON, a LargE scale iMage captiONer, and provide the first empirical study on the scaling behavior of VLP for image captioning. We use the state of the art VinVL model as our reference model, which consists of an image feature extractor and a transformer model, and scale the transformer both up and down, with model sizes ranging from 13 to 675 million parameters. In terms of data, we conduct experiments with up to 200 million image text pairs which are automatically collected from web based on the alt attribute of the image (dubbed as ALT200M). Extensive analysis helps to characterize the performance trend as the model size and the pre training data size increase. We also compare different training recipes, especially for training on large scale noisy data. As a result, LEMON achieves new state of the arts on several major image captioning benchmarks, including COCO Caption, nocaps, and Conceptual Captions. We also show LEMON can generate captions with long tail visual concepts when used in a zero shot manner.


A probabilistic model for fast to evaluate 2D crack path prediction in heterogeneous materials. This paper is devoted to the construction of a new fast to evaluate model for the prediction of 2D crack paths in concrete like microstructures. The model generates piecewise linear cracks paths with segmentation points selected using a Markov chain model. The Markov chain kernel involves local indicators of mechanical interest and its parameters are learnt from numerical full field 2D simulations of craking using a cohesive volumetric finite element solver called XPER. The resulting model exhibits a drastic improvement of CPU time in comparison to simulations from XPER.


Genus 1 Curves in Severi Brauer Surfaces. In a talk at the Banff International Research Station in 2015 Asher Auel asked questions about genus one curves in Severi Brauer varieties SB(A) . More specifically he asked about the smooth cubic curves in Severi Brauer surfaces, that is in SB(D) where D F is a degree three division algebra. Even more specifically, he asked about the Jacobian, E , of these curves. In this paper we give a version of an answer to both these questions, describing the surprising connection between these curves and properties of the algebra A . Let F contain rho , a primitive third root of one. Since D F is cyclic, it is generated over F by x,y such that xy rho yx and we call x,y a skew commuting pairs. The connection mentioned above is between the Galois structure of the three torsion points E 3 and the Galois structure of skew commuting pairs in extensions D otimes F K . Given a description of which E arise, we then describe, via Galois cohomology, which C arise.


Table Caption Generation in Scholarly Documents Leveraging Pre trained Language Models. This paper addresses the problem of generating table captions for scholarly documents, which often require additional information outside the table. To this end, we propose a method of retrieving relevant sentences from the paper body, and feeding the table content as well as the retrieved sentences into pre trained language models (e.g. T5 and GPT 2) for generating table captions. The contributions of this paper are (1) discussion on the challenges in table captioning for scholarly documents (2) development of a dataset DocBank TB, which is publicly available and (3) comparison of caption generation methods for scholarly documents with different strategies to retrieve relevant sentences from the paper body. Our experimental results showed that T5 is the better generation model for this task, as it outperformed GPT 2 in BLEU and METEOR implying that the generated text are clearer and more precise. Moreover, inputting relevant sentences matching the row header or whole table is effective.


NP completeness of the Active Time Scheduling Problem. In this paper, we study the active time scheduling problem. We are given n jobs with integral processing times each of which has an integral release time and deadline. The goal is to schedule all the jobs on a machine that can work on b jobs simultaneously, and the objective is to minimize the number of time slots for which the machine is active. The active time scheduling model was introduced by Chang et al. in the context of energy efficient scheduling. Surprisingly, despite the development of a number of constant factor approximation algorithms for the problem, the complexity of this fundamental problem had remained open. In this paper, we resolve this open problem and show that the active time scheduling problem is indeed NP complete.


Scalable Bayesian Deep Learning with Kernel Seed Networks. This paper addresses the scalability problem of Bayesian deep neural networks. The performance of deep neural networks is undermined by the fact that these algorithms have poorly calibrated measures of uncertainty. This restricts their application in high risk domains such as computer aided diagnosis and autonomous vehicle navigation. Bayesian Deep Learning (BDL) offers a promising method for representing uncertainty in neural network. However, BDL requires a separate set of parameters to store the mean and standard deviation of model weights to learn a distribution. This results in a prohibitive 2 fold increase in the number of model parameters. To address this problem we present a method for performing BDL, namely Kernel Seed Networks (KSN), which does not require a 2 fold increase in the number of parameters. KSNs use 1x1 Convolution operations to learn a compressed latent space representation of the parameter distribution. In this paper we show how this allows KSNs to outperform conventional BDL methods while reducing the number of required parameters by up to a factor of 6.6.


DoWhy Addressing Challenges in Expressing and Validating Causal Assumptions. Estimation of causal effects involves crucial assumptions about the data generating process, such as directionality of effect, presence of instrumental variables or mediators, and whether all relevant confounders are observed. Violation of any of these assumptions leads to significant error in the effect estimate. However, unlike cross validation for predictive models, there is no global validator method for a causal estimate. As a result, expressing different causal assumptions formally and validating them (to the extent possible) becomes critical for any analysis. We present DoWhy, a framework that allows explicit declaration of assumptions through a causal graph and provides multiple validation tests to check a subset of these assumptions. Our experience with DoWhy highlights a number of open questions for future research developing new ways beyond causal graphs to express assumptions, the role of causal discovery in learning relevant parts of the graph, and developing validation tests that can better detect errors, both for average and conditional treatment effects. DoWhy is available at https github.com microsoft dowhy.


Improved Accuracy and Precision In Simultaneous Myocardial T1 and T2 mapping with Multi Parametric SASHA (mSASHA). Purpose To develop and validate a multi parametric SAturation recovery single SHot Acquisition (mSASHA) cardiac T1 and T2 mapping technique with high accuracy and precision in a single breath hold. Methods The mSASHA acquisition consists of 9 images in an 11 heartbeat breath hold the first without preparation, 6 images with saturation recovery preparation, and 2 images with both saturation recovery and T2 preparation. T1 and T2 values were calculated using a 3 parameter model. mSASHA was validated in simulations and phantoms on a Siemens 3T Prisma scanner with comparison to a joint T1 T2 technique with a 4 parameter model. mSASHA values were compared to reference MOLLI, SASHA and T2p bSSFP sequences in 10 healthy volunteers. Results mSASHA had high accuracy compared to reference spin echo measurements, with an average of 0.7 0.4 T1 error and 1.3 1.3 T2 error. mSASHA coefficient of variation (CoV) in phantoms for T1 was lower than MOLLI (0.7 0.1 vs 0.9 0.2 , p 0.01) and similar to reference T2p bSSFP for T2 (1.4 0.6 vs 1.5 0.5 , p 0.05). In simulations, 3 parameter mSASHA fitting had higher precision than 4 parameter joint T1 T2 fitting for both T1 and T2. In vivo myocardial mSASHA T1 was similar to conventional SASHA (1523 18 ms vs 1520 18 ms, p 0.05) with similar CoV to both MOLLI and SASHA (3.3 0.6 vs 3.1 0.6 and 3.3 0.5 respectively, p 0.05 for both). Myocardial mSASHA T2 values were 37.1 1.1 ms with similar precision to T2p bSSFP (6.7 1.7 vs 6.0 1.6 , p 0.05). Conclusion mSASHA provides high accuracy cardiac T1 and T2 quantification in a single breath hold, with similar precision to reference MOLLI and linear T2p bSSFP reference techniques.


Patterns of ICT usage in disaster in Samoa. The study discussed in this paper focuses on ICT use during disasters in Samoa and is a replicate of a study carried out in 2015. The study used a survey to explore how Samoan citizens use technology, act on different types of information, and how the information source or media affects decisions to act during a disaster. Findings revealed that traditional broadcasting were still the most prominent, most important, and still predominate in early warning and disaster response. However, there were now increasing usage of mobile and social media in disaster communications. Findings also revealed that people trust official reporters the most as source of information in times of crisis. The intent is that findings from this study can contribute to a people centred approach to early warning and disaster providing empowerment to affected individuals to act in a timely and appropriate manner to ensure survival in times of disaster.


Geometric Algebra Attention Networks for Small Point Clouds. Much of the success of deep learning is drawn from building architectures that properly respect underlying symmetry and structure in the data on which they operate a set of considerations that have been united under the banner of geometric deep learning. Often problems in the physical sciences deal with relatively small sets of points in two or three dimensional space wherein translation, rotation, and permutation equivariance are important or even vital for models to be useful in practice. In this work, we present rotation and permutation equivariant architectures for deep learning on these small point clouds, composed of a set of products of terms from the geometric algebra and reductions over those products using an attention mechanism. The geometric algebra provides valuable mathematical structure by which to combine vector, scalar, and other types of geometric inputs in a systematic way to account for rotation invariance or covariance, while attention yields a powerful way to impose permutation equivariance. We demonstrate the usefulness of these architectures by training models to solve sample problems relevant to physics, chemistry, and biology.


Elongated focus optoacoustic microscopy with matched Bessel beam illumination and ultra broadband axicon detection. Current optoacoustic microscopy configurations often have narrow focal ranges that limit their use for fast volumetric imaging applications. Here, the focal range of optoacoustic microscopes is extended by matching the elongated optical illumination profile of a Bessel beam with the pencil beam acoustic sensitivity profile of a broadband axicon detector. An inverted optoacoustic microscope was developed with interchangeable optical illumination and acoustic detection units to assess the imaging depths and resolutions retained with several combinations of illumination and detection profiles. Matching Bessel illumination with axicon detection extends the depth of focus 17 fold over traditional configurations. Imaging a tilted mouse ear with the matched Bessel axicon configuration revealed vasculature over an imaging depth exceeding 4.2 mm with optical resolution, while affording a 6 fold increase in imaging volume over the same scanning duration compared to configurations employing standard Gaussian illumination, demonstrating this approach's promise for increasing applications for optoacoustic microscopy in preclinical research.


Online Adversarial Purification based on Self Supervision. Deep neural networks are known to be vulnerable to adversarial examples, where a perturbation in the input space leads to an amplified shift in the latent network representation. In this paper, we combine canonical supervised learning with self supervised representation learning, and present Self supervised Online Adversarial Purification (SOAP), a novel defense strategy that uses a self supervised loss to purify adversarial examples at test time. Our approach leverages the label independent nature of self supervised signals and counters the adversarial perturbation with respect to the self supervised tasks. SOAP yields competitive robust accuracy against state of the art adversarial training and purification methods, with considerably less training complexity. In addition, our approach is robust even when adversaries are given knowledge of the purification defense strategy. To the best of our knowledge, our paper is the first that generalizes the idea of using self supervised signals to perform online test time purification.


Inclusion of Domain Knowledge into GNNs using Mode Directed Inverse Entailment. We present a general technique for constructing Graph Neural Networks (GNNs) capable of using multi relational domain knowledge. The technique is based on mode directed inverse entailment (MDIE) developed in Inductive Logic Programming (ILP). Given a data instance e and background knowledge B , MDIE identifies a most specific logical formula bot B(e) that contains all the relational information in B that is related to e . We represent bot B(e) by a "bottom graph" that can be converted into a form suitable for GNN implementations. This transformation allows a principled way of incorporating generic background knowledge into GNNs we use the term BotGNN' for this form of graph neural networks. For several GNN variants, using real world datasets with substantial background knowledge, we show that BotGNNs perform significantly better than both GNNs without background knowledge and a recently proposed simplified technique for including domain knowledge into GNNs. We also provide experimental evidence comparing BotGNNs favourably to multi layer perceptrons (MLPs) that use features representing a "propositionalised" form of the background knowledge and BotGNNs to a standard ILP based on the use of most specific clauses. Taken together, these results point to BotGNNs as capable of combining the computational efficacy of GNNs with the representational versatility of ILP.


Volume of convex polytopes equals mixed volume of simplices. This note provides a simple proof for the equality between the normalized volume of a convex polytope with m vertices and the mixed volume of m simplices and thus shows the seemingly restrictive problem of computing mixed volume of simplices is still at least as hard as computing volumes of convex polytopes.


Quality meets Diversity A Model Agnostic Framework for Computerized Adaptive Testing. Computerized Adaptive Testing (CAT) is emerging as a promising testing application in many scenarios, such as education, game and recruitment, which targets at diagnosing the knowledge mastery levels of examinees on required concepts. It shows the advantage of tailoring a personalized testing procedure for each examinee, which selects questions step by step, depending on her performance. While there are many efforts on developing CAT systems, existing solutions generally follow an inflexible model specific fashion. That is, they need to observe a specific cognitive model which can estimate examinee's knowledge levels and design the selection strategy according to the model estimation. In this paper, we study a novel model agnostic CAT problem, where we aim to propose a flexible framework that can adapt to different cognitive models. Meanwhile, this work also figures out CAT solution with addressing the problem of how to generate both high quality and diverse questions simultaneously, which can give a comprehensive knowledge diagnosis for each examinee. Inspired by Active Learning, we propose a novel framework, namely Model Agnostic Adaptive Testing (MAAT) for CAT solution, where we design three sophisticated modules including Quality Module, Diversity Module and Importance Module. Extensive experimental results on two real world datasets clearly demonstrate that our MAAT can support CAT with guaranteeing both quality and diversity perspectives.


Learning to Rank Question Answer Pairs with Bilateral Contrastive Data Augmentation. In this work, we propose a novel and easy to apply data augmentation strategy, namely Bilateral Generation (BiG), with a contrastive training objective for improving the performance of ranking question answer pairs with existing labeled data. In specific, we synthesize pseudo positive QA pairs in contrast to the original negative QA pairs with two pre trained generation models, one for question generation, the other for answer generation, which are fine tuned on the limited positive QA pairs from the original dataset. With the augmented dataset, we design a contrastive training objective for learning to rank question answer pairs. Experimental results on three benchmark datasets show that our method significantly improves the performance of ranking models by making full use of existing labeled data and can be easily applied to different ranking models.


A Grothendieck topos of generalized functions I basic theory. The main aim of the present work is to arrive at a mathematical theory close to the historically original conception of generalized functions, i.e. set theoretical functions defined on, and with values in, a suitable ring of scalars and sharing a number of fundamental properties with smooth functions, in particular with respect to composition and nonlinear operations. This is how they are still used in informal calculations in Physics. We introduce a category of generalized functions as smooth set theoretical maps on (multidimensional) points of a ring of scalars containing infinitesimals and infinities. This category extends Schwartz distributions. The calculus of these generalized functions is closely related to classical analysis, with point values, composition, non linear operations and the generalization of several classical theorems of calculus. Finally, we extend this category of generalized functions into a Grothendieck topos of sheaves over a concrete site. This topos hence provides a suitable framework for the study of spaces and functions with singularities. In this first paper, we present the basic theory subsequent ones will be devoted to the resulting theory of ODE and PDE.


A FMI Learning Attributions from Deep Networks via Feature Map Importance. Gradient based attribution methods can aid in the understanding of convolutional neural networks (CNNs). However, the redundancy of attribution features and the gradient saturation problem, which weaken the ability to identify significant features and cause an explanation focus shift, are challenges that attribution methods still face. In this work, we propose 1) an essential characteristic, Strong Relevance, when selecting attribution features 2) a new concept, feature map importance (FMI), to refine the contribution of each feature map, which is faithful to the CNN model and 3) a novel attribution method via FMI, termed A FMI, to address the gradient saturation problem, which couples the target image with a reference image, and assigns the FMI to the difference from reference at the granularity of feature map. Through visual inspections and qualitative evaluations on the ImageNet dataset, we show the compelling advantages of A FMI on its faithfulness, insensitivity to the choice of reference, class discriminability, and superior explanation performance compared with popular attribution methods across varying CNN architectures.


Is Sparse Attention more Interpretable?. Sparse attention has been claimed to increase model interpretability under the assumption that it highlights influential inputs. Yet the attention distribution is typically over representations internal to the model rather than the inputs themselves, suggesting this assumption may not have merit. We build on the recent work exploring the interpretability of attention we design a set of experiments to help us understand how sparsity affects our ability to use attention as an explainability tool. On three text classification tasks, we verify that only a weak relationship between inputs and co indexed intermediate representations exists under sparse attention and otherwise. Further, we do not find any plausible mappings from sparse attention distributions to a sparse set of influential inputs through other avenues. Rather, we observe in this setting that inducing sparsity may make it less plausible that attention can be used as a tool for understanding model behavior.


Methane detection to 1 ppm using machine learning analysis of atmospheric pressure plasma optical emission spectra. Optical emission spectroscopy from a small volume, 5 uL, atmospheric pressure RF driven helium plasma was used in conjunction with Partial Least Squares Discriminant Analysis (PLS DA) for the detection of trace concentrations of methane gas. A limit of detection of 1 ppm was obtained and sample concentrations up to 100 ppm CH4 were classified using a nine category model. A range of algorithm enhancements were investigated including regularization, simple data segmentation and subset selection, VIP feature selection and wavelength variable compression in order to address the high dimensionality and collinearity of spectral emission data. These approaches showed the potential for significant reduction in the number of wavelength variables and the spectral resolution bandwidth. Wavelength variable compression exhibited reliable predictive performance, with accuracy values 97 , under more challenging multi session train test scenarios. Simple modelling of plasma electron energy distribution functions highlights the complex cross sensitivities between the target methane, its dissociation products and atmospheric impurities and their impact on excitation and emission.


On Frobenius exact symmetric tensor categories. A fundamental theorem of P. Deligne (2002) states that a pre Tannakian category over an algebraically closed field of characteristic zero admits a fiber functor to the category of supervector spaces (i.e., is the representation category of an affine proalgebraic supergroup) if and only if it has moderate growth (i.e., the lengths of tensor powers of an object grow at most exponentially). In this paper we prove a characteristic p version of this theorem. Namely we show that a pre Tannakian category over an algebraically closed field of characteristic p 0 admits a fiber functor into the Verlinde category Ver p (i.e., is the representation category of an affine group scheme in Ver p) if and only if it has moderate growth and is Frobenius exact. This implies that Frobenius exact pre Tannakian categories of moderate growth admit a well behaved notion of Frobenius Perron dimension. It follows that any semisimple pre Tannakian category of moderate growth has a fiber functor to Ver p (so in particular Deligne's theorem holds on the nose for semisimple pre Tannakian categories in characteristics 2,3). This settles a conjecture of the third author from 2015. In particular, this result applies to semisimplifications of categories of modular representations of finite groups (or, more generally, affine group schemes), which gives new applications to classical modular representation theory. For example, it allows us to characterize, for a modular representation V, the possible growth rates of the number of indecomposable summands in V otimes n of dimension prime to p.


Teacher Model Fingerprinting Attacks Against Transfer Learning. Transfer learning has become a common solution to address training data scarcity in practice. It trains a specified student model by reusing or fine tuning early layers of a well trained teacher model that is usually publicly available. However, besides utility improvement, the transferred public knowledge also brings potential threats to model confidentiality, and even further raises other security and privacy issues. In this paper, we present the first comprehensive investigation of the teacher model exposure threat in the transfer learning context, aiming to gain a deeper insight into the tension between public knowledge and model confidentiality. To this end, we propose a teacher model fingerprinting attack to infer the origin of a student model, i.e., the teacher model it transfers from. Specifically, we propose a novel optimization based method to carefully generate queries to probe the student model to realize our attack. Unlike existing model reverse engineering approaches, our proposed fingerprinting method neither relies on fine grained model outputs, e.g., posteriors, nor auxiliary information of the model architecture or training dataset. We systematically evaluate the effectiveness of our proposed attack. The empirical results demonstrate that our attack can accurately identify the model origin with few probing queries. Moreover, we show that the proposed attack can serve as a stepping stone to facilitating other attacks against machine learning models, such as model stealing.


How Big Should Your Data Really Be? Data Driven Newsvendor Learning One Sample at a Time. We study the classical newsvendor problem in which the decision maker must trade off underage and overage costs. In contrast to the typical setting, we assume that the decision maker does not know the underlying distribution driving uncertainty but has only access to historical data. In turn, the key questions are how to map existing data to a decision and what type of performance to expect as a function of the data size. We analyze the classical setting with access to past samples drawn from the distribution (e.g., past demand), focusing not only on asymptotic performance but also on what we call the transient regime of learning, i.e., performance for arbitrary data sizes. We evaluate the performance of any algorithm through its worst case relative expected regret, compared to an oracle with knowledge of the distribution. We provide the first finite sample exact analysis of the classical Sample Average Approximation (SAA) algorithm for this class of problems across all data sizes. This allows to uncover novel fundamental insights on the value of data it reveals that tens of samples are sufficient to perform very efficiently but also that more data can lead to worse out of sample performance for SAA. We then focus on the general class of mappings from data to decisions without any restriction on the set of policies and derive an optimal algorithm (in the minimax sense) as well as characterize its associated performance. This leads to significant improvements for limited data sizes, and allows to exactly quantify the value of historical information.


Evaluation of Dynamic Cointegration Based Pairs Trading Strategy in the Cryptocurrency Market. This research aims to demonstrate a dynamic cointegration based pairs trading strategy, including an optimal look back window framework in the cryptocurrency market, and evaluate its return and risk by applying three different scenarios. We employ the Engle Granger methodology, the Kapetanios Snell Shin (KSS) test, and the Johansen test as cointegration tests in different scenarios. We calibrate the mean reversion speed of the Ornstein Uhlenbeck process to obtain the half life used for the asset selection phase and look back window estimation. By considering the main limitations in the market microstructure, our strategy exceeds the naive buy and hold approach in the Bitmex exchange. Another significant finding is that we implement a numerous collection of cryptocurrency coins to formulate the model's spread, which improves the risk adjusted profitability of the pairs trading strategy. Besides, the strategy's maximum drawdown level is reasonably low, which makes it useful to be deployed. The results also indicate that a class of coins has better potential arbitrage opportunities than others. This research has some noticeable advantages, making it stand out from similar studies in the cryptocurrency market. First is the accuracy of data in which minute binned data create the signals in the formation period. Besides, to backtest the strategy during the trading period, we simulate the trading signals using best bid ask quotes and market trades. We exclusively take the order execution into account when the asset size is already available at its quoted price (with one or more period gaps after signal generation). This action makes the backtesting much more realistic.


Step unrolled Denoising Autoencoders for Text Generation. In this paper we propose a new generative model of text, Step unrolled Denoising Autoencoder (SUNDAE), that does not rely on autoregressive models. Similarly to denoising diffusion techniques, SUNDAE is repeatedly applied on a sequence of tokens, starting from random inputs and improving them each time until convergence. We present a simple new improvement operator that converges in fewer iterations than diffusion methods, while qualitatively producing better samples on natural language datasets. SUNDAE achieves state of the art results (among non autoregressive methods) on the WMT'14 English to German translation task and good qualitative results on unconditional language modeling on the Colossal Cleaned Common Crawl dataset and a dataset of Python code from GitHub. The non autoregressive nature of SUNDAE opens up possibilities beyond left to right prompted generation, by filling in arbitrary blank patterns in a template.


A Survey on IoT Smart Healthcare Emerging Technologies, Applications, Challenges, and Future Trends. The internet of things (IoT) refers to a framework of interrelated, web associated objects that can gather and move information over a remote network without human interference. With a quick development in the arrangement of IoT gadgets and expanding want to make medical care more financially savvy, customized, and proactive, IoT is ready to assume a solid function in all perspectives of the healthcare industry. In this context, IoT based healthcare provides several benefits such as instant and reliable treatment, cost reduction, improved communication, etc. by using different new technologies. Wireless Body Area Networks (WBAN) technologies can enhance the quality of data gathering and data transferring in smart systems. Machine Learning(ML) are put to use at every level of smart healthcare systems. Fog computing reduces communication cost and provides low latency. Software Defined Networking (SDN) and Network Function Virtualization (NFV) technologies provide less complex and more flexible network structures. Blockchain technology offers a better way of protection of users' sensitive information. This paper aims to provide comprehensive descriptions of ongoing research projects and the utilization of the above mentioned technologies in smart healthcare systems. In this paper, the latest studies, proposed techniques, and the current solutions of smart healthcare systems are elaborated in the context of emerging technologies, applications and challenges of these systems to provide a better understanding of what IoT means in the healthcare industry now and what it will mean in the future.


Periodicity and longtime diffusion for mean field systems in mathbb R d . We study in this paper the longtime behavior of some large but finite populations of interacting stochastic differential equations whose (infinite population) limit Fokker Planck PDE admits a stable periodic solution. We show that the empirical measure for the population of size N stays close to the periodic solution, but with a random dephasing at the timescale Nt that converges weakly to a Brownian motion with constant drift.


Mobile Augmented Reality User Interfaces, Frameworks, and Intelligence. Mobile Augmented Reality (MAR) integrates computer generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head worn wearables, and performs seamless transitions from the physical world to a mixed world with digital entities. These MAR systems support user experiences by using MAR devices to provide universal accessibility to digital contents. Over the past 20 years, a number of MAR systems have been developed, however, the studies and design of MAR frameworks have not yet been systematically reviewed from the perspective of user centric design. This article presents the first effort of surveying existing MAR frameworks (count 37) and further discusses the latest studies on MAR through a top down approach 1) MAR applications 2) MAR visualisation techniques adaptive to user mobility and contexts 3) systematic evaluation of MAR frameworks including supported platforms and corresponding features such as tracking, feature extraction plus sensing capabilities and 4) underlying machine learning approaches supporting intelligent operations within MAR systems. Finally, we summarise the development of emerging research fields, current state of the art, and discuss the important open challenges and possible theoretical and technical directions. This survey aims to benefit both researchers and MAR system developers alike.


Fine tuning neural excitation inhibition for tailored ketamine use in treatment resistant depression. The glutamatergic modulator ketamine has been shown to rapidly reduce depressive symptoms in patients with treatment resistant major depressive disorder (TRD). Although its mechanisms of action are not fully understood, changes in cortical excitation inhibition (E I) following ketamine administration are well documented in animal models and could represent a potential biomarker of treatment response. Here, we analyse neuromagnetic virtual electrode timeseries collected from the primary somatosensory cortex in 18 unmedicated patients with TRD and in an equal number of age matched healthy controls during a somatosensory 'airpuff' stimulation task. These two groups were scanned as part of a clinical trial of ketamine efficacy under three conditions a) baseline b) 6 9 hours following subanesthetic ketamine infusion and c) 6 9 hours following placebo saline infusion. We obtained estimates of E I interaction strengths by using Dynamic Causal Modelling (DCM) on the timeseries, thereby allowing us to pinpoint, under each scanning condition, where each subject's dynamics lie within the Poincar 'e diagram as defined in dynamical systems theory. We demonstrate that the Poincar 'e diagram offers classification capability for TRD patients, in that the further the patients' coordinates were shifted (by virtue of ketamine) toward the stable (top left) quadrant of the Poincar 'e diagram, the more their depressive symptoms improved. The same relationship was not observed by virtue of a placebo effect thereby verifying the drug specific nature of the results. We show that the shift in neural dynamics required for symptom improvement necessitates an increase in both excitatory and inhibitory coupling. We present accompanying MATLAB code made available in a public repository, thereby allowing for future studies to assess individually tailored treatments of TRD.


Deep neural networks for geometric multigrid methods. We investigate scaling and efficiency of the deep neural network multigrid method (DNN MG). DNN MG is a novel neural network based technique for the simulation of the Navier Stokes equations that combines an adaptive geometric multigrid solver, i.e. a highly efficient classical solution scheme, with a recurrent neural network with memory. The neural network replaces in DNN MG one or multiple finest multigrid layers and provides a correction for the classical solve in the next time step. This leads to little degradation in the solution quality while substantially reducing the overall computational costs. At the same time, the use of the multigrid solver at the coarse scales allows for a compact network that is easy to train, generalizes well, and allows for the incorporation of physical constraints. Previous work on DNN MG focused on the overall scheme and how to enforce divergence freedom in the solution. In this work, we investigate how the network size affects training and solution quality and the overall runtime of the computations. Our results demonstrate that larger networks are able to capture the flow behavior better while requiring only little additional training time. At runtime, the use of the neural network correction can even reduce the computation time compared to a classical multigrid simulation through a faster convergence of the nonlinear solve that is required at every time step.


Multi Scale Feature and Metric Learning for Relation Extraction. Existing methods in relation extraction have leveraged the lexical features in the word sequence and the syntactic features in the parse tree. Though effective, the lexical features extracted from the successive word sequence may introduce some noise that has little or no meaningful content. Meanwhile, the syntactic features are usually encoded via graph convolutional networks which have restricted receptive field. To address the above limitations, we propose a multi scale feature and metric learning framework for relation extraction. Specifically, we first develop a multi scale convolutional neural network to aggregate the non successive mainstays in the lexical sequence. We also design a multi scale graph convolutional network which can increase the receptive field towards specific syntactic roles. Moreover, we present a multi scale metric learning paradigm to exploit both the feature level relation between lexical and syntactic features and the sample level relation between instances with the same or different classes. We conduct extensive experiments on three real world datasets for various types of relation extraction tasks. The results demonstrate that our model significantly outperforms the state of the art approaches.


Putting Data Science Pipelines on the Edge. This paper proposes a composable "Just in Time Architecture" for Data Science (DS) Pipelines named JITA 4DS and associated resource management techniques for configuring disaggregated data centers (DCs). DCs under our approach are composable based on vertical integration of the application, middleware operating system, and hardware layers customized dynamically to meet application Service Level Objectives (SLO application aware management). Thereby, pipelines utilize a set of flexible building blocks that can be dynamically and automatically assembled and re assembled to meet the dynamic changes in the workload's SLOs. To assess disaggregated DC's, we study how to model and validate their performance in large scale settings.


PointBA Towards Backdoor Attacks in 3D Point Cloud. 3D deep learning has been increasingly more popular for a variety of tasks including many safety critical applications. However, recently several works raise the security issues of 3D deep models. Although most of them consider adversarial attacks, we identify that backdoor attack is indeed a more serious threat to 3D deep learning systems but remains unexplored. We present the backdoor attacks in 3D point cloud with a unified framework that exploits the unique properties of 3D data and networks. In particular, we design two attack approaches on point cloud the poison label backdoor attack (PointPBA) and the clean label backdoor attack (PointCBA). The first one is straightforward and effective in practice, while the latter is more sophisticated assuming there are certain data inspections. The attack algorithms are mainly motivated and developed by 1) the recent discovery of 3D adversarial samples suggesting the vulnerability of deep models under spatial transformation 2) the proposed feature disentanglement technique that manipulates the feature of the data through optimization methods and its potential to embed a new task. Extensive experiments show the efficacy of the PointPBA with over 95 success rate across various 3D datasets and models, and the more stealthy PointCBA with around 50 success rate. Our proposed backdoor attack in 3D point cloud is expected to perform as a baseline for improving the robustness of 3D deep models.


Estimation of the last passage percolation constant in a charged complete directed acyclic graph via perfect simulation. Our object of study is the asymptotic growth of heaviest paths in a charged (weighted with signed weights) complete directed acyclic graph. Edge charges are i.i.d. random variables with common distribution F supported on infty,1 with essential supremum equal to 1 (a charge of infty is understood as the absence of an edge). The asymptotic growth rate is a constant that we denote by C(F) . Even in the simplest case where F p delta 1 (1 p) delta infty , corresponding to the longest path in the Barak Erd H o s random graph, there is no closed form expression for this function, but good bounds do exist. In this paper we construct a Markovian particle system that we call "Max Growth System" (MGS), and show how it is related to the charged random graph. The MGS is a generalization of the Infinite Bin Model that has been the object of study of a number of papers. We then identify a random functional of the process that admits a stationary version and whose expectation equals the unknown constant C(F) . Furthermore, we construct an effective perfect simulation algorithm for this functional which produces samples from the random functional.


Even factors in edge chromatic critical graphs with a small number of divalent vertices. A finite simple graph G with maximum degree k is k critical if it has chromatic index chi'(G) k 1 and chi'(G e) k for every edge e in E(G) . Bej and the first author raised the question whether every k critical graph has an even factor. We prove that every k critical graph with at most 2k 6 vertices of degree 2 has an even factor.