SPoTKD A Protocol for Symmetric Key Distribution over Public Channels Using Self Powered Timekeeping Devices. In this paper, we propose a novel class of symmetric key distribution protocols that leverages basic security primitives offered by low cost, hardware chipsets containing millions of synchronized self powered timers. The keys are derived from the temporal dynamics of a physical, micro scale time keeping device which makes the keys immune to any potential side channel attacks, malicious tampering, or snooping. Using the behavioral model of the self powered timers, we first show that the derived key strings can pass the randomness test as defined by the National Institute of Standards and Technology (NIST) suite. The key strings are then used in two SPoTKD (Self Powered Timer Key Distribution) protocols that exploit the timer's dynamics as one way functions (a) protocol 1 facilitates secure communications between a user and a remote Server, and (b) protocol 2 facilitates secure communications between two users. In this paper, we investigate the security of these protocols under standard model and against different adversarial attacks. Using Monte Carlo simulations, we also investigate the robustness of these protocols in the presence of real world operating conditions and propose error correcting SPoTKD protocols to mitigate these noise related artifacts.


Irreducibility and singularities of some nested Hilbert schemes. Let S be a smooth projective surface over mathbb C . We study the local and global geometry of the nested Hilbert scheme of points S n,n 1,n 2 . In particular, we show that S n,n 1,n 2 is an irreducible local complete intersection with klt singularities. In addition, we compute the Picard group of S n,n 1,n 2 when h 1(S, mathcal O S) 0 . From the irreducibility of S n,n 1,n 2 , we deduce irreducibility for four other infinite families of nested Hilbert schemes. We give the first explicit example of a reducible nested Hilbert scheme, which allows us to show that S n 1, dots,n k is reducible for k 22 .


Magnetic unit vector fields. We show that a unit vector field on an oriented Riemannian manifold is a critical point of the Landau Hall functional if and only if it is a critical point of the Dirichlet energy functional. Therefore, we provide a characterization for a unit vector field to be a magnetic map into its unit tangent sphere bundle. Then, we classify all magnetic left invariant unit vector fields on 3 dimensional Lie groups.


Margin Independent Online Multiclass Learning via Convex Geometry. We consider the problem of multi class classification, where a stream of adversarially chosen queries arrive and must be assigned a label online. Unlike traditional bounds which seek to minimize the misclassification rate, we minimize the total distance from each query to the region corresponding to its correct label. When the true labels are determined via a nearest neighbor partition i.e. the label of a point is given by which of k centers it is closest to in Euclidean distance we show that one can achieve a loss that is independent of the total number of queries. We complement this result by showing that learning general convex sets requires an almost linear loss per query. Our results build off of regret guarantees for the geometric problem of contextual search. In addition, we develop a novel reduction technique from multiclass classification to binary classification which may be of independent interest.


A global branch approach to normalized solutions for the Schr "odinger equation. We present a novel approach to study the existence, non existence and multiplicity of prescribed mass positive solutions to a Schr "odinger equation of the form begin equation Delta u lambda u g(u), quad u in H 1( mathbb R N), , N geq 1. end equation This approach permits to handle in a unified way nonlinearities g(s) which are either mass subcritical, mass critical or mass supercritical. Among its main ingredients is the study of the asymptotic behaviors of the positive solutions as lambda rightarrow 0 or lambda rightarrow infty and the existence of an unbounded continuum of solutions in (0, infty) times H 1( mathbb R N)


Investigating Perceptions of Social Intelligence in Simulated Human Chatbot Interactions. With the ongoing penetration of conversational user interfaces, a better understanding of social and emotional characteristic inherent to dialogue is required. Chatbots in particular face the challenge of conveying human like behaviour while being restricted to one channel of interaction, i.e., text. The goal of the presented work is thus to investigate whether characteristics of social intelligence embedded in human chatbot interactions are perceivable by human interlocutors and if yes, whether such influences the experienced interaction quality. Focusing on the social intelligence dimensions Authenticity, Clarity and Empathy, we first used a questionnaire survey evaluating the level of perception in text utterances, and then conducted a Wizard of Oz study to investigate the effects of these utterances in a more interactive setting. Results show that people have great difficulties perceiving elements of social intelligence in text. While on the one hand they find anthropomorphic behaviour pleasant and positive for the naturalness of a dialogue, they may also perceive it as frightening and unsuitable when expressed by an artificial agent in the wrong way or at the wrong time.


The weight two compactly supported Euler characteristic of moduli spaces of curves. We derive a formula for the generating function for the weight two compactly supported mathbb S n equivariant Euler characteristics of the moduli spaces of curves mathcal M g,n , using graph complexes and calculations inspired by operadic methods.


New formulas for cup i products and fast computation of Steenrod squares. Operations on the cohomology of spaces are important tools enhancing the descriptive power of this computable invariant. For cohomology with mod 2 coefficients, Steenrod squares are the most significant of these operations. Their effective computation relies on formulas defining a cup i construction, a structure on (co)chains which is important in its own right, having connections to lattice field theory, convex geometry and higher category theory among others. In this article we present new formulas defining a cup i construction, and use them to introduce a fast algorithm for the computation of Steenrod squares on the cohomology of finite simplicial complexes. In forthcoming work we use these formulas to axiomatically characterize the cup i construction they define, showing additionally that all other formulas in the literature define the same cup i construction up to isomorphism.


Modelling COVID 19 Pandemic Dynamics Using Transparent, Interpretable, Parsimonious and Simulatable (TIPS) Machine Learning Models A Case Study from Systems Thinking and System Identification Perspectives. Since the outbreak of COVID 19, an astronomical number of publications on the pandemic dynamics appeared in the literature, of which many use the susceptible infected removed (SIR) and susceptible exposed infected removed (SEIR) models, or their variants, to simulate and study the spread of the coronavirus. SIR and SEIR are continuous time models which are a class of initial value problems (IVPs) of ordinary differential equations (ODEs). Discrete time models such as regression and machine learning have also been applied to analyze COVID 19 pandemic data (e.g. predicting infection cases), but most of these methods use simplified models involving a small number of input variables pre selected based on a priori knowledge, or use very complicated models (e.g. deep learning), purely focusing on certain prediction purposes and paying little attention to the model interpretability. There have been relatively fewer studies focusing on the investigations of the inherent time lagged or time delayed relationships e.g. between the reproduction number (R number), infection cases, and deaths, analyzing the pandemic spread from a systems thinking and dynamic perspective. The present study, for the first time, proposes using systems engineering and system identification approach to build transparent, interpretable, parsimonious and simulatable (TIPS) dynamic machine learning models, establishing links between the R number, the infection cases and deaths caused by COVID 19. The TIPS models are developed based on the well known NARMAX (Nonlinear AutoRegressive Moving Average with eXogenous inputs) model, which can help better understand the COVID 19 pandemic dynamics. A case study on the UK COVID 19 data is carried out, and new findings are detailed. The proposed method and the associated new findings are useful for better understanding the spread dynamics of the COVID 19 pandemic.


Following excited state chemical shifts in molecular ultrafast x ray photoelectron spectroscopy. The conversion of photon energy into other energetic forms in molecules is accompanied by charge moving on ultrafast timescales. We directly observe the charge motion at a specific site in an electronically excited molecule using time resolved x ray photoelectron spectroscopy (TR XPS). We extend the concept of static chemical shift from conventional XPS by the excited state chemical shift (ESCS), which is connected to the charge in the framework of a potential model. This allows us to invert TR XPS spectra to the dynamic charge at a specific atom. We demonstrate the power of TR XPS by using sulphur 2p core electron emission probing to study the UV excited dynamics of 2 thiouracil. The new method allows us to discover that a major part of the population relaxes to the molecular ground state within 220 250 fs. In addition, a 250 fs oscillation, visible in the kinetic energy of the TR XPS, reveals a coherent exchange of population among electronic states.


Federated Generalized Face Presentation Attack Detection. Face presentation attack detection plays a critical role in the modern face recognition pipeline. A face presentation attack detection model with good generalization can be obtained when it is trained with face images from different input distributions and different types of spoof attacks. In reality, training data (both real face images and spoof images) are not directly shared between data owners due to legal and privacy issues. In this paper, with the motivation of circumventing this challenge, we propose a Federated Face Presentation Attack Detection (FedPAD) framework that simultaneously takes advantage of rich fPAD information available at different data owners while preserving data privacy. In the proposed framework, each data center locally trains its own fPAD model. A server learns a global fPAD model by iteratively aggregating model updates from all data centers without accessing private data in each of them. To equip the aggregated fPAD model in the server with better generalization ability to unseen attacks from users, following the basic idea of FedPAD, we further propose a Federated Generalized Face Presentation Attack Detection (FedGPAD) framework. A federated domain disentanglement strategy is introduced in FedGPAD, which treats each data center as one domain and decomposes the fPAD model into domain invariant and domain specific parts in each data center. Two parts disentangle the domain invariant and domain specific features from images in each local data center, respectively. A server learns a global fPAD model by only aggregating domain invariant parts of the fPAD models from data centers and thus a more generalized fPAD model can be aggregated in server. We introduce the experimental setting to evaluate the proposed FedPAD and FedGPAD frameworks and carry out extensive experiments to provide various insights about federated learning for fPAD.


GLOWin A Flow based Invertible Generative Framework for Learning Disentangled Feature Representations in Medical Images. Disentangled representations can be useful in many downstream tasks, help to make deep learning models more interpretable, and allow for control over features of synthetically generated images that can be useful in training other models that require a large number of labelled or unlabelled data. Recently, flow based generative models have been proposed to generate realistic images by directly modeling the data distribution with invertible functions. In this work, we propose a new flow based generative model framework, named GLOWin, that is end to end invertible and able to learn disentangled representations. Feature disentanglement is achieved by factorizing the latent space into components such that each component learns the representation for one generative factor. Comprehensive experiments have been conducted to evaluate the proposed method on a public brain tumor MR dataset. Quantitative and qualitative results suggest that the proposed method is effective in disentangling the features from complex medical images.


Boundary Control of the Beam Equation by Linear Quadratic Regulation. We present and solve a Linear Quadratic Regulator (LQR) for the boundary control of the beam equation. We use the simple technique of completing the square to get an explicit solution. By decoupling the spatial frequencies we are able to reduce an infinite dimensional LQR to an infinte family of two two dimensional LQRs each of which can be solved explicitly.


An exact solution to dispersion of a passive scalar by a periodic shear flow. We present an exact analytical solution to the problem of shear dispersion given a general initial condition. The solution is expressed as an infinite series expansion involving Mathieu functions and their eigenvalues. The eigenvalue system depends on the imaginary parameter q 2ik Pe, with k the wavenumber that determines the tracer scale in the initial condition and Pe the P ' e clet number. Solutions are valid for all Pe, t 0 , and k 0 except at specific values of q q ell EP called Exceptional Points (EPs), the first occurring at q 0 EP approx1.468i . For values of q lessapprox 1.468i , all the eigenvalues are real, different and eigenfunctions decay with time, thus shear dispersion can be represented as a diffusive process. For values of q gtrapprox 1.468i , pairs of eigenvalues coalesce at EPs becoming complex conjugates, the eigenfunctions propagate and decay with time, and so shear dispersion is no longer a purely diffusive process. The limit q rightarrow0 is approached by the small P ' e clet number limit for all finite k 0 , or equally by the large P ' e clet number limit as long as 2k ll 1 Pe. The latter implies k rightarrow0 , strong separation of scales between the tracer and flow. The limit q rightarrow infty results from large P ' e clet number for any k 0 , or from large k and non vanishing Pe. We derive an exact closure that is continuous in wavenumber space. At small q , the closure approaches a diffusion operator with an effective diffusivity proportional to U 0 2 kappa , for flow speed U 0 and diffusivity kappa . At large q , the closure approaches the sum of an advection operator plus a half derivative operator (differential operator of fractional order), the latter with coefficient proportional to sqrt kappa U 0 .


Around the Chevalley Weil Theorem. We present a proof of the Chevalley Weil Theorem that is somewhat different from the proofs appearing in the literature and with somewhat weaker hypotheses, of purely topological type. We also provide a discussion of the assumptions, and an application to solutions of generalized Fermat equations, where our statement allows to simplify the original argument of Darmon and Granville.


Graph based Label Propagation for Semi Supervised Speaker Identification. Speaker identification in the household scenario (e.g., for smart speakers) is typically based on only a few enrollment utterances but a much larger set of unlabeled data, suggesting semisupervised learning to improve speaker profiles. We propose a graph based semi supervised learning approach for speaker identification in the household scenario, to leverage the unlabeled speech samples. In contrast to most of the works in speaker recognition that focus on speaker discriminative embeddings, this work focuses on speaker label inference (scoring). Given a pre trained embedding extractor, graph based learning allows us to integrate information about both labeled and unlabeled utterances. Considering each utterance as a graph node, we represent pairwise utterance similarity scores as edge weights. Graphs are constructed per household, and speaker identities are propagated to unlabeled nodes to optimize a global consistency criterion. We show in experiments on the VoxCeleb dataset that this approach makes effective use of unlabeled data and improves speaker identification accuracy compared to two state of the art scoring methods as well as their semi supervised variants based on pseudo labels.


OMB Py Python Micro Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems. Python has become a dominant programming language for emerging areas like Machine Learning (ML), Deep Learning (DL), and Data Science (DS). An attractive feature of Python is that it provides easy to use programming interface while allowing library developers to enhance performance of their applications by harnessing the computing power offered by High Performance Computing (HPC) platforms. Efficient communication is key to scaling applications on parallel systems, which is typically enabled by the Message Passing Interface (MPI) standard and compliant libraries on HPC hardware. mpi4py is a Python based communication library that provides an MPI like interface for Python applications allowing application developers to utilize parallel processing elements including GPUs. However, there is currently no benchmark suite to evaluate communication performance of mpi4py and Python MPI codes in general on modern HPC systems. In order to bridge this gap, we propose OMB Py Python extensions to the open source OSU Micro Benchmark (OMB) suite aimed to evaluate communication performance of MPI based parallel applications in Python. To the best of our knowledge, OMB Py is the first communication benchmark suite for parallel Python applications. OMB Py consists of a variety of point to point and collective communication benchmark tests that are implemented for a range of popular Python libraries including NumPy, CuPy, Numba, and PyCUDA. We also provide Python implementation for several distributed ML algorithms as benchmarks to understand the potential gain in performance for ML DL workloads. Our evaluation reveals that mpi4py introduces a small overhead when compared to native MPI libraries. We also evaluate the ML DL workloads and report up to 106x speedup on 224 CPU cores compared to sequential execution. We plan to publicly release OMB Py to benefit Python HPC community.


VoteHMR Occlusion Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds. 3D human mesh recovery from point clouds is essential for various tasks, including AR VR and human behavior understanding. Previous works in this field either require high quality 3D human scans or sequential point clouds, which cannot be easily applied to low quality 3D scans captured by consumer level depth sensors. In this paper, we make the first attempt to reconstruct reliable 3D human shapes from single frame partial point clouds.To achieve this, we propose an end to end learnable method, named VoteHMR. The core of VoteHMR is a novel occlusion aware voting network that can first reliably produce visible joint level features from the input partial point clouds, and then complete the joint level features through the kinematic tree of the human skeleton. Compared with holistic features used by previous works, the joint level features can not only effectively encode the human geometry information but also be robust to noisy inputs with self occlusions and missing areas. By exploiting the rich complementary clues from the joint level features and global features from the input point clouds, the proposed method encourages reliable and disentangled parameter predictions for statistical 3D human models, such as SMPL. The proposed method achieves state of the art performances on two large scale datasets, namely SURREAL and DFAUST. Furthermore, VoteHMR also demonstrates superior generalization ability on real world datasets, such as Berkeley MHAD.


"I Won the Election!" An Empirical Analysis of Soft Moderation Interventions on Twitter. Over the past few years, there is a heated debate and serious public concerns regarding online content moderation, censorship, and the principle of free speech on the Web. To ease these concerns, social media platforms like Twitter and Facebook refined their content moderation systems to support soft moderation interventions. Soft moderation interventions refer to warning labels attached to potentially questionable or harmful content to inform other users about the content and its nature while the content remains accessible, hence alleviating concerns related to censorship and free speech. In this work, we perform one of the first empirical studies on soft moderation interventions on Twitter. Using a mixed methods approach, we study the users who share tweets with warning labels on Twitter and their political leaning, the engagement that these tweets receive, and how users interact with tweets that have warning labels. Among other things, we find that 72 of the tweets with warning labels are shared by Republicans, while only 11 are shared by Democrats. By analyzing content engagement, we find that tweets with warning labels had more engagement compared to tweets without warning labels. Also, we qualitatively analyze how users interact with content that has warning labels finding that the most popular interactions are related to further debunking false claims, mocking the author or content of the disputed tweet, and further reinforcing or resharing false claims. Finally, we describe concrete examples of inconsistencies, such as warning labels that are incorrectly added or warning labels that are not added on tweets despite sharing questionable and potentially harmful information.


On lattice width of lattice free polyhedra and height of Hilbert bases. We study the lattice width of lattice free polyhedra given by mathbf A mathbf x leq mathbf b in terms of Delta( mathbf A ) , the maximal n times n minor in absolute value of mathbf A in mathbb Z m times n . Our main contribution is to link the lattice width of lattice free polyhedra to the height of Hilbert bases and to the diameter of finite abelian groups. This leads to a bound on the lattice width of lattice free pyramids which solely depends on Delta( mathbf A ) provided a conjecture regarding the height of Hilbert bases holds. Further, we exploit a combination of techniques to obtain novel bounds on the lattice width of simplices. A second part of the paper is devoted to a study of the above mentioned Hilbert basis conjecture. We give a complete characterization of the Hilbert basis if Delta( mathbf A ) 2 which implies the conjecture in that case and prove its validity for simplicial cones.


Eigenvalues of the Birman Schwinger operator for singular measures the noncritical case. In a domain Omega subseteq mathbb R mathbf N we consider compact, Birman Schwinger type, operators of the form mathbf T P, mathfrak A mathfrak A P mathfrak A here P is a singular Borel measure in Omega and mathfrak A is a noncritical order l ne mathbf N 2 pseudodifferential operator. For a class of such operators, we obtain estimates and a proper version of H.Weyl's asymptotic law for eigenvalues, with order depending on dimensional characteristics of the measure. A version of the CLR estimate for singular measures is proved. For non selfadjoint operators of the form P 2 mathfrak A P 1 and mathfrak A 2 P mathfrak A 1 with singular measures P,P 1,P 2 and negative order pseudodifferential operators mathfrak A , mathfrak A 1, mathfrak A 2 we obtain estimates for singular numbers.


K AID Enhancing Pre trained Language Models with Domain Knowledge for Question Answering. Knowledge enhanced pre trained language models (K PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice. To address this problem, we propose K AID, a systematic approach that includes a low cost knowledge acquisition process for acquiring domain knowledge, an effective knowledge infusion module for improving model performance, and a knowledge distillation component for reducing the model size and deploying K PLMs on resource restricted devices (e.g., CPU) for real world application. Importantly, instead of capturing entity knowledge like the majority of existing K PLMs, our approach captures relational knowledge, which contributes to better improving sentence level text classification and text matching tasks that play a key role in question answering (QA). We conducted a set of experiments on five text classification tasks and three text matching tasks from three domains, namely E commerce, Government, and Film TV, and performed online A B tests in E commerce. Experimental results show that our approach is able to achieve substantial improvement on sentence level question answering tasks and bring beneficial business value in industrial settings.


Intertwining periods and distinction for p adic Galois symmetric pairs. We consider distinction of representations in the context of p adic Galois symmetric spaces. We provide new sufficient conditions for distinction of parabolically induced representations in terms of similar conditions on the inducing data and deduce a characterization for distinction of representations parabolically induced from cuspidal. We explicate the results further for classical groups and give several applications, in particular, concerning the preservation of distinction via Langlands functoriality. We relate our results with a conjecture of Dipendra Prasad.


Semantic Aware Contrastive Learning for Multi object Medical Image Segmentation. Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel level semantic mask. To increase the ability of encoder decoder neural networks to perform this task across large clinical cohorts, contrastive learning provides an opportunity to stabilize model initialization and enhance encoders without labels. However, multiple target objects (with different semantic meanings) may exist in a single image, which poses a problem for adapting traditional contrastive learning methods from prevalent 'image level classification' to 'pixel level segmentation'. In this paper, we propose a simple semantic aware contrastive learning approach leveraging attention masks to advance multi object semantic segmentation. Briefly, we embed different semantic objects to different clusters rather than the traditional image level embeddings. We evaluate our proposed method on a multi organ medical image segmentation task with both in house data and MICCAI Challenge 2015 BTCV datasets. Compared with current state of the art training strategies, our proposed pipeline yields a substantial improvement of 5.53 and 6.09 on Dice score for both medical image segmentation cohorts respectively (p value 0.01). The performance of the proposed method is further assessed on natural images via the PASCAL VOC 2012 dataset, and achieves a substantial improvement of 2.75 on mIoU (p value 0.01).


A Kinetic Flux Difference Splitting Method for Compressible Flows. A low diffusive flux difference splitting based kinetic scheme is developed based on a discrete velocity Boltzmann equation, with a novel three velocity model. While two discrete velocities are used for upwinding, the third discrete velocity is utilized to introduce appropriate additional numerical diffusion only in the expansion regions, identified using relative entropy (Kullback Liebler divergence) at the cell interface, along with the estimation of physical entropy. This strategy provides an interesting alternative to entropy fix, which is typically needed for low diffusive schemes. Grid aligned steady discontinuities are captured exactly by fixing the numerical diffusion such that flux equivalence leads to zero numerical diffusion across discontinuities. Results for bench mark test problems are presented for inviscid and viscous compressible flows.


Analyzing Dynamic Adversarial Training Data in the Limit. To create models that are robust across a wide range of test inputs, training datasets should include diverse examples that span numerous phenomena. Dynamic adversarial data collection (DADC), where annotators craft examples that challenge continually improving models, holds promise as an approach for generating such diverse training sets. Prior work has shown that running DADC over 1 3 rounds can help models fix some error types, but it does not necessarily lead to better generalization beyond adversarial test data. We argue that running DADC over many rounds maximizes its training time benefits, as the different rounds can together cover many of the task relevant phenomena. We present the first study of longer term DADC, where we collect 20 rounds of NLI examples for a small set of premise paragraphs, with both adversarial and non adversarial approaches. Models trained on DADC examples make 26 fewer errors on our expert curated test set compared to models trained on non adversarial data. Our analysis shows that DADC yields examples that are more difficult, more lexically and syntactically diverse, and contain fewer annotation artifacts compared to non adversarial examples.


Single and Double Scattering Mechanisms in Ionization of Helium by Electron Vortex Projectiles. Triple differential cross sections (TDCSs) for electron vortex projectile ionization of helium into the azimuthal plane are calculated using the distorted wave Born approximation. In this collision geometry, the TDCSs at low and intermediate energies exhibit unique qualitative features that can be used to identify single and double scattering mechanisms. In general, our results predict that the ionization dynamics for vortex projectiles are similar to those of their non vortex counterparts. However, some key differences are observed. For non vortex projectiles, a double scattering mechanism is required to emit electrons into the azimuthal plane, and this mechanism becomes more important with increasing energy. Our results demonstrate that for vortex projectiles, emission into the azimuthal plane does not require a double scattering mechanism, although this process still significantly influences the shape of the TDCS at higher energies. At low projectile energies, non vortex ionization proceeds primarily through single binary collisions. The same is generally true for vortex projectiles, although our results indicate that double scattering is also important, even at low energy. Vortex projectiles have an inherent uncertainty in their incident momentum, which causes a broadening of the binary peak at all energies and results in a splitting of the binary peak at higher energies. The results presented here lead to several predictions that can be experimentally tested.


Confidential Token Based License Management. In a global economy with many competitive participants, licensing and tracking of 3D printed parts is desirable if not mandatory for many use cases. We investigate a blockchain based approach, as blockchains provide many attractive features, like decentralized architecture and high security assurances. An often neglected aspect of the product life cycle management is the confidentiality of transactions to hide valuable business information from competitors. To solve the combined problem of trust and confidentiality, we present a confidential licensing and tracking system which works on any publicly verifiable, token based blockchain that supports tokens of different types representing licenses or attributes of parts. Together with the secure integration of a unique eID in each part, our system provides an efficient, immutable and authenticated transaction log scalable to thousands of transactions per second. With our confidential Token Based License Management system (cTLM), large industries such as automotive or aviation can license and trace all parts confidentially.


Retro Drug Design From Target Properties to Molecular Structures. To generate drug molecules of desired properties with computational methods is the holy grail in pharmaceutical research. Here we describe an AI strategy, retro drug design, or RDD, to generate novel small molecule drugs from scratch to meet predefined requirements, including but not limited to biological activity against a drug target, and optimal range of physicochemical and ADMET properties. Traditional predictive models were first trained over experimental data for the target properties, using an atom typing based molecular descriptor system, ATP. Monte Carlo sampling algorithm was then utilized to find the solutions in the ATP space defined by the target properties, and the deep learning model of Seq2Seq was employed to decode molecular structures from the solutions. To test feasibility of the algorithm, we challenged RDD to generate novel drugs that can activate mu opioid receptor (MOR) and penetrate blood brain barrier (BBB). Starting from vectors of random numbers, RDD generated 180,000 chemical structures, of which 78 were chemically valid. About 42,000 (31 ) of the valid structures fell into the property space defined by MOR activity and BBB permeability. Out of the 42,000 structures, only 267 chemicals were commercially available, indicating a high extent of novelty of the AI generated compounds. We purchased and assayed 96 compounds, and 25 of which were found to be MOR agonists. These compounds also have excellent BBB scores. The results presented in this paper illustrate that RDD has potential to revolutionize the current drug discovery process and create novel structures with multiple desired properties, including biological functions and ADMET properties. Availability of an AI enabled fast track in drug discovery is essential to cope with emergent public health threat, such as pandemic of COVID 19.


Domain Adaptation In Reinforcement Learning Via Latent Unified State Representation. Despite the recent success of deep reinforcement learning (RL), domain adaptation remains an open problem. Although the generalization ability of RL agents is critical for the real world applicability of Deep RL, zero shot policy transfer is still a challenging problem since even minor visual changes could make the trained agent completely fail in the new task. To address this issue, we propose a two stage RL agent that first learns a latent unified state representation (LUSR) which is consistent across multiple domains in the first stage, and then do RL training in one source domain based on LUSR in the second stage. The cross domain consistency of LUSR allows the policy acquired from the source domain to generalize to other target domains without extra training. We first demonstrate our approach in variants of CarRacing games with customized manipulations, and then verify it in CARLA, an autonomous driving simulator with more complex and realistic visual observations. Our results show that this approach can achieve state of the art domain adaptation performance in related RL tasks and outperforms prior approaches based on latent representation based RL and image to image translation.


Robust Feature Learning on Long Duration Sounds for Acoustic Scene Classification. Acoustic scene classification (ASC) aims to identify the type of scene (environment) in which a given audio signal is recorded. The log mel feature and convolutional neural network (CNN) have recently become the most popular time frequency (TF) feature representation and classifier in ASC. An audio signal recorded in a scene may include various sounds overlapping in time and frequency. The previous study suggests that separately considering the long duration sounds and short duration sounds in CNN may improve ASC accuracy. This study addresses the problem of the generalization ability of acoustic scene classifiers. In practice, acoustic scene signals' characteristics may be affected by various factors, such as the choice of recording devices and the change of recording locations. When an established ASC system predicts scene classes on audios recorded in unseen scenarios, its accuracy may drop significantly. The long duration sounds not only contain domain independent acoustic scene information, but also contain channel information determined by the recording conditions, which is prone to over fitting. For a more robust ASC system, We propose a robust feature learning (RFL) framework to train the CNN. The RFL framework down weights CNN learning specifically on long duration sounds. The proposed method is to train an auxiliary classifier with only long duration sound information as input. The auxiliary classifier is trained with an auxiliary loss function that assigns less learning weight to poorly classified examples than the standard cross entropy loss. The experimental results show that the proposed RFL framework can obtain a more robust acoustic scene classifier towards unseen devices and cities.


Description of laminar turbulent transition of an airfoil boundary layer measured by differential image thermography using directed percolation theory. Transition from laminar to turbulent flow is still a challenging problem. Recent studies indicate a good agreement when describing this phase transition with the directed percolation theory. This study presents a new experimental approach by means of differential image thermography (DIT) enabling to investigate this transition on the suction side of a heated airfoil. The results extend the applicability of the directed percolation theory to describe the transition on curves surfaces. The experimental effort allows for the first time an agreement between all three universal exponents of the (1 1)D directed percolation for such airfoil application. Furthermore, this study proves that the theory holds for a wide range of flows, as shown by the various conditions tested. Such a large parameter space was not covered in any examination so far. The findings underline the significance of percolation models in fluid mechanics and show that this theory can be used as a high precision tool for the problem of transition to turbulence.


The spectrum of a class of graphs derived from Grassmann graphs. Let n,k be positive integers such that n geq 3 , k frac n 2 . Let q be a power of a prime p and mathbb F q be a finite field of order q . Let V(q,n) be a vector space of dimension n over mathbb F q . We define the graph S(q,n,k) as a graph with the vertex set V V k cup V k 1 , where V k and V k 1 are the family of subspaces in V(q,n) of dimension k and k 1 respectively, in which two vertices v and w are adjacent whenever v is a subspace of w or w is a subspace of v . It is clear that the graph S(q,n,k) is a bipartite graph. In this paper, we study some properties of this graph. In particular, we determine the spectrum of the graph S(q,n,k) .


Investigating the Impact of Pre trained Language Models on Dialog Evaluation. Recently, there is a surge of interest in applying pre trained language models (Pr LM) in automatic open domain dialog evaluation. Pr LMs offer a promising direction for addressing the multi domain evaluation challenge. Yet, the impact of different Pr LMs on the performance of automatic metrics is not well understood. This paper examines 8 different Pr LMs and studies their impact on three typical automatic dialog evaluation metrics across three different dialog evaluation benchmarks. Specifically, we analyze how the choice of Pr LMs affects the performance of automatic metrics. Extensive correlation analyses on each of the metrics are performed to assess the effects of different Pr LMs along various axes, including pre training objectives, dialog evaluation criteria, model size, and cross dataset robustness. This study serves as the first comprehensive assessment of the effects of different Pr LMs on automatic dialog evaluation.


Remarks about the Arithmetic of Graphs. The arithmetic of N, Z, Q, R can be extended to a graph arithmetic where N is the semiring of finite simple graphs and where Z and Q are integral domains, culminating in a Banach algebra R. A single network completes to the Wiener algebra. We illustrate the compatibility with topology and spectral theory. Multiplicative linear functionals like Euler characteristic, the Poincare polynomial or the zeta functions can be extended naturally. These functionals can also help with number theoretical questions. The story of primes is a bit different as the integers are not a unique factorization domain, because there are many additive primes. Most graphs are multiplicative primes.


On existence and uniqueness of asymptotic N soliton like solutions of the nonlinear klein gordon equation. We are interested in solutions of the nonlinear Klein Gordon equation (NLKG) in mathbb R 1 d , d ge1 , which behave as a soliton or a sum of solitons in large time. In the spirit of other articles focusing on the supercritical generalized Korteweg de Vries equations and on the nonlinear Schr "o dinger equations, we obtain an N parameter family of solutions of (NLKG) which converges exponentially fast to a sum of given (unstable) solitons. For N 1 , this family completely describes the set of solutions converging to the soliton considered for N ge 2 , we prove uniqueness in a class with explicit algebraic rate of convergence.


Zelevinsky Duality on Basic Local Shimura Varieties. We give a simple proof of a general result describing the action of the Zelevinsky involution on the cohomology of certain basic local Shimura varieties, using the machinery of Fargues Scholze. As an application, we generalize earlier results of Fargues and Mieda on the action of the Zelevinsky involution on the cohomology of GL n and GSp 4 type basic local Shimura varieties, respectively.


HyperDynamics Meta Learning Object and Agent Dynamics with Hypernetworks. We propose HyperDynamics, a dynamics meta learning framework that conditions on an agent's interactions with the environment and optionally its visual observations, and generates the parameters of neural dynamics models based on inferred properties of the dynamical system. Physical and visual properties of the environment that are not part of the low dimensional state yet affect its temporal dynamics are inferred from the interaction history and visual observations, and are implicitly captured in the generated parameters. We test HyperDynamics on a set of object pushing and locomotion tasks. It outperforms existing dynamics models in the literature that adapt to environment variations by learning dynamics over high dimensional visual observations, capturing the interactions of the agent in recurrent state representations, or using gradient based meta optimization. We also show our method matches the performance of an ensemble of separately trained experts, while also being able to generalize well to unseen environment variations at test time. We attribute its good performance to the multiplicative interactions between the inferred system properties captured in the generated parameters and the low dimensional state representation of the dynamical system.


The Uniform Mordell Lang Conjecture. In this paper, we prove the Uniform Mordell Lang Conjecture for subvarieties in abelian varieties. As a byproduct, we prove the Uniform Bogomolov Conjecture for subvarieties in abelian varieties.


Notes on endomorphisms, local cohomology and completion. Let M denote a finitely generated module over a Noetherian ring R . For an ideal I subset R there is a study of the endomorphisms of the local cohomology module H g I(M), g operatorname grade (I,M), and related results. Another subject is the study of left derived functors of the I adic completion Lambda I i(H g I(M)) , motivated by a characterization of Gorenstein rings given in the book by Simon and the author. This provides another Cohen Macaulay criterion. The results are illustrated by several examples. There is also an extension to the case of homomorphisms of two different local cohomology modules.


Transmit Correlation Diversity Generalization, New Techniques, and Improved Bounds. When the users in a MIMO broadcast channel experience different spatial transmit correlation matrices, a class of gains is produced that is denoted transmit correlation diversity. This idea was conceived for channels in which transmit correlation matrices have mutually exclusive eigenspaces, allowing non interfering training and transmission. This paper broadens the scope of transmit correlation diversity to the case of partially and fully overlapping eigenspaces and introduces techniques to harvest these generalized gains. For the two user MIMO broadcast channel, we derive achievable degrees of freedom (DoF) and achievable rate regions with without channel state information at the receiver (CSIR). When CSIR is available, the proposed achievable DoF region is tight in some configurations of the number of receive antennas and the channel correlation ranks. We then extend the DoF results to the K user case by analyzing the interference graph that characterizes the overlapping structure of the eigenspaces. Our achievability results employ a combination of product superposition in the common part of the eigenspaces, and pre beamforming (rate splitting) to create multiple data streams in non overlapping parts of the eigenspaces. Massive MIMO is a natural example in which spatially correlated link gains are likely to occur. We study the achievable downlink sum rate for a frequency division duplex massive MIMO system under transmit correlation diversity.


A Polynomial Time Algorithm for a NPC Problem. It is introduced a so called 'Multi stage graph Simple Path' problem (MSP for short) and proved that SAT problem can be polynomial reducible to MSP problem in this small paper. To solve MSP problem, we propose a polynomial time algorithm. Our result implies NP P.


Definable Equivariant Retractions in Non Archimedean Geometry. For G an algebraic group definable over a model of operatorname ACVF , or more generally a definable subgroup of an algebraic group, we study the stable completion widehat G of G , as introduced by Loeser and the second author. For G connected and stably dominated, assuming G commutative or that the valued field is of equicharacteristic 0, we construct a pro definable G equivariant strong deformation retraction of widehat G onto the generic type of G . For G S a semiabelian variety, we construct a pro definable S equivariant strong deformation retraction of widehat S onto a definable group which is internal to the value group. We show that, in case S is defined over a complete valued field K with value group a subgroup of mathbb R , this map descends to an S(K) equivariant strong deformation retraction of the Berkovich analytification S mathrm an of S onto a piecewise linear group, namely onto the skeleton of S mathrm an . This yields a construction of such a retraction without resorting to an analytic (non algebraic) uniformization of S . Furthermore, we prove a general result on abelian groups definable in an NIP theory any such group G is a directed union of infty definable subgroups which all stabilize a generically stable Keisler measure on G .


A Priori Calibration of Transient Kinetics Data via Machine Learning. The temporal analysis of products reactor provides a vast amount of transient kinetic information that may be used to describe a variety of chemical features including the residence time distribution, kinetic coefficients, number of active sites, and the reaction mechanism. However, as with any measurement device, the TAP reactor signal is convoluted with noise. To reduce the uncertainty of the kinetic measurement and any derived parameters or mechanisms, proper preprocessing must be performed prior to any advanced analysis. This preprocessing consists of baseline correction, i.e., a shift in the voltage response, and calibration, i.e., a scaling of the flux response based on prior experiments. The current methodology of preprocessing requires significant user discretion and reliance on previous experiments that may drift over time. Herein we use machine learning techniques combined with physical constraints to convert the raw instrument signal to chemical information. As such, the proposed methodology demonstrates clear benefits over the traditional preprocessing in the calibration of the inert and feed mixture products without need of prior calibration experiments or heuristic input from the user.


Continual Backprop Stochastic Gradient Descent with Persistent Randomness. The Backprop algorithm for learning in neural networks utilizes two mechanisms first, stochastic gradient descent and second, initialization with small random weights, where the latter is essential to the effectiveness of the former. We show that in continual learning setups, Backprop performs well initially, but over time its performance degrades. Stochastic gradient descent alone is insufficient to learn continually the initial randomness enables only initial learning but not continual learning. To the best of our knowledge, ours is the first result showing this degradation in Backprop's ability to learn. To address this degradation in Backprop's plasticity, we propose an algorithm that continually injects random features alongside gradient descent using a new generate and test process. We call this the textit Continual Backprop algorithm. We show that, unlike Backprop, Continual Backprop is able to continually adapt in both supervised and reinforcement learning (RL) problems. Continual Backprop has the same computational complexity as Backprop and can be seen as a natural extension of Backprop for continual learning.


Nil generated algebras and group algebras whose units satify a Laurent polynomial identity. Let A be an algebra whose group of units U(A) satisfies a Laurent polynomial identity (LPI). We establish conditions on these polynomials in such a way that nil generated algebras and group algebras with torsion groups over infinite fields in characteristic p 0 have nonmatrix identities. We also determine, in the determine in the context of group algebras with arbitrary LPI for the group of units, the existence of polynomial identities.


A simple yet consistent constitutive law and mortar based layer coupling schemes for thermomechanical macroscale simulations of metal additive manufacturing processes. This article proposes a coupled thermomechanical finite element model tailored to the macroscale simulation of metal additive manufacturing processes such as selective laser melting. A first focus lies on the derivation of a consistent constitutive law on basis of a Voigt type spatial homogenization procedure across the relevant phases, powder, melt and solid. The proposed constitutive law accounts for the irreversibility of phase change and consistently represents thermally induced residual stresses. In particular, the incorporation of a reference strain term, formulated in rate form, allows to consistently enforce a stress free configuration for newly solidifying material at melt temperature. Application to elementary test cases demonstrates the validity of the proposed constitutive law and allows for a comparison with analytical and reference solutions. Moreover, these elementary solidification scenarios give detailed insights and foster understanding of basic mechanisms of residual stress generation in melting and solidification problems with localized, moving heat sources. As a second methodological aspect, dual mortar mesh tying strategies are proposed for the coupling of successively applied powder layers. This approach allows for very flexible mesh generation for complex geometries. As compared to collocation type coupling schemes, e.g., based on hanging nodes, these mortar methods enforce the coupling conditions between non matching meshes in an L 2 optimal manner. The combination of the proposed constitutive law and mortar mesh tying approach is validated on realistic three dimensional examples, representing a first step towards part scale predictions.


Algebraic models of dependent type theory. The rules governing the essentially algebraic notion of a category with families have been observed (independently) by Steve Awodey and Marcelo Fiore to precisely match those of a representable natural transformation between presheaves. This provides us with a natural, functorial description of essentially algebraic objects which are used to model dependent type theory following Steve Awodey, we call them 'natural models'. We can view natural models from several different viewpoints, of which we focus on three in this thesis. First, natural models are essentially algebraic, meaning that they can be described by specifying operations between sorts, subject to equational axioms this allows us to assemble natural models into a category with certain beneficial properties. Second, since natural models are natural transformations between presheaves, they are morphisms in a locally cartesian closed category, meaning that they can be regarded as polynomials. Third, since natural models admit interpretations of dependent type theory, we can use them to provide a functorial semantics.


Infinite families of higher torsion in the homotopy groups of Moore spaces. We give a refinement of the stable Snaith splitting of the double loop space of a Moore space and use it to construct infinite v 1 periodic families of elements of order p r 1 in the homotopy groups of mod p r Moore spaces. For odd primes p , our splitting implies that the homotopy groups of the mod p r 1 Moore spectrum are summands of the unstable homotopy groups of each mod p r Moore space.


Sound Absorption and Transmission Loss Properties of Open Celled Aluminum Foams with Stepwise Relative Density Gradients. We investigate the acoustical properties of uncompressed and compressed open celled aluminum metal foams fabricated using a directional solidification foaming process. We compressed the fabricated foams using a hydraulic press to different compression ratios and characterized the effect of compression on the cellular microstructure using microtomography and scanning electron microscopy. The static airflow resistances of the samples are measured and related to the observed microstructural changes. We measured the normal incidence acoustical properties using two and four microphone impedance tube methods and show that the compression substantially improves their sound absorption and transmission loss performance. We then stack individual disks with different compression ratios to create various stepwise relative density gradient configurations and show that stepwise gradients provide a significant improvement in properties as compared to the uncompressed sample. The effect of increasing and decreasing relative density gradients on the overall absorption and transmission loss behavior is characterized. Finally, we use an experimentally informed and validated transfer matrix method to predict the effect of various layer thicknesses and stacking sequences on the global acoustical properties. Our results show that open celled metal foams with stepwise relative density gradients can be designed to provide tailored acoustic absorption performance while reducing the overall weight of the noise reduction package.


Bilevel Imaging Learning Problems as Mathematical Programs with Complementarity Constraints. We investigate a family of bilevel imaging learning problems where the lower level instance corresponds to a convex variational model involving first and second order nonsmooth regularizers. By using geometric properties of the primal dual reformulation of the lower level problem and introducing suitable changes of variables, we are able to reformulate the original bilevel problems as Mathematical Programs with Complementarity Constraints (MPCC). For the latter, we prove tight constraint qualification conditions (MPCC MFCQ and partial MPCC LICQ) and derive Mordukovich (M ) and Strong (S ) stationarity conditions. The S stationarity system for the MPCC turns also into S stationarity conditions for the original formulation. Second order sufficient optimality conditions are derived as well. The proposed reformulation may be extended to problems in function spaces, leading to MPCC's with additional constraints on the gradient of the state. Finally, we report on some numerical results obtained by using the proposed MPCC reformulations together with available large scale nonlinear programming solvers.


Origami expanders. We construct a new type of expanders, from measure preserving affine actions with spectral gap on origami surfaces, in each genus g geqslant 1 . These actions are the first examples of actions with spectral gap on surfaces of genus g 1 . We prove that the new expanders are coarsely distinct from the classical expanders obtained via the Laplacian as Cayley graphs of finite quotients of a group. In genus g 1 , this implies that the Margulis expander, and hence the Gabber Galil expander, is coarsely distinct from the Selberg expander. For the proof, we use the concept of piecewise asymptotic dimension and show a coarse rigidity result A coarse embedding of either mathbb R 2 or mathbb H 2 into either mathbb R 2 or mathbb H 2 is a quasi isometry.


Binary sequences with low correlation via cyclotomic function fields. Due to wide applications of binary sequences with low correlation to communications, various constructions of such sequences have been proposed in literature. However, most of the known constructions via finite fields make use of the multiplicative cyclic group of F 2 n . It is often overlooked in this community that all 2 n 1 rational places (including "place at infinity") of the rational function field over F 2 n form a cyclic structure under an automorphism of order 2 n 1 . In this paper, we make use of this cyclic structure to provide an explicit construction of families of binary sequences of length 2 n 1 via the finite field F 2 n . Each family of sequences has size 2 n 1 and its correlation is upper bounded by lfloor 2 (n 2) 2 rfloor . Our sequences can be constructed explicitly and have competitive parameters. In particular, compared with the Gold sequences of length 2 n 1 for even n , we have larger length and smaller correlation although the family size of our sequences is slightly smaller.


Reappraising Domain Generalization in Neural Networks. Given that Neural Networks generalize unreasonably well in the IID setting (with benign overfitting and betterment in performance with more parameters), OOD presents a consistent failure case to better the understanding of how they learn. This paper focuses on Domain Generalization (DG), which is perceived as the front face of OOD generalization. We find that the presence of multiple domains incentivizes domain agnostic learning and is the primary reason for generalization in Tradition DG. We show that the state of the art results can be obtained by borrowing ideas from IID generalization and the DG tailored methods fail to add any performance gains. Furthermore, we perform explorations beyond the Traditional DG (TDG) formulation and propose a novel ClassWise DG (CWDG) benchmark, where for each class, we randomly select one of the domains and keep it aside for testing. Despite being exposed to all domains during training, CWDG is more challenging than TDG evaluation. We propose a novel iterative domain feature masking approach, achieving state of the art results on the CWDG benchmark. Overall, while explaining these observations, our work furthers insights into the learning mechanisms of neural networks.


Attention based Reinforcement Learning for Real Time UAV Semantic Communication. In this article, we study the problem of air to ground ultra reliable and low latency communication (URLLC) for a moving ground user. This is done by controlling multiple unmanned aerial vehicles (UAVs) in real time while avoiding inter UAV collisions. To this end, we propose a novel multi agent deep reinforcement learning (MADRL) framework, coined a graph attention exchange network (GAXNet). In GAXNet, each UAV constructs an attention graph locally measuring the level of attention to its neighboring UAVs, while exchanging the attention weights with other UAVs so as to reduce the attention mismatch between them. Simulation results corroborates that GAXNet achieves up to 4.5x higher rewards during training. At execution, without incurring inter UAV collisions, GAXNet achieves 6.5x lower latency with the target 0.0000001 error rate, compared to a state of the art baseline framework.


Solution decomposition for the nonlinear Poisson Boltzmann equation using the range separated tensor format. The Poisson Boltzmann equation (PBE) is an implicit solvent continuum model for calculating the electrostatic potential and energies of ionic solvated biomolecules. However, its numerical solution remains a significant challenge due strong singularities and nonlinearity caused by the singular source terms and the exponential nonlinear terms, respectively. An efficient method for the treatment of singularities in the linear PBE was introduced in cite BeKKKS 18 , that is based on the RS tensor decomposition for both electrostatic potential and the discretized Dirac delta distribution. In this paper, we extend this regularization method to the nonlinear PBE. We apply the PBE only to the regular part of the solution corresponding to the modified right hand side via extraction of the long range part in the discretized Dirac delta distribution. The total electrostatic potential is obtained by adding the long range solution to the directly precomputed short range potential. The main computational benefit of the approach is the automatic maintaining of the continuity in the Cauchy data on the solute solvent interface. The boundary conditions are also obtained from the long range component of the precomputed canonical tensor representation of the Newton kernel. In the numerical experiments, we illustrate the accuracy of the nonlinear regularized PBE (NRPBE) over the classical variant.


QDOT Quantized Dot Product Kernel for Approximate High Performance Computing. Approximate computing techniques have been successful in reducing computation and power costs in several domains. However, error sensitive applications in high performance computing are unable to benefit from existing approximate computing strategies that are not developed with guaranteed error bounds. While approximate computing techniques can be developed for individual high performance computing applications by domain specialists, this often requires additional theoretical analysis and potentially extensive software modification. Hence, the development of low level error bounded approximate computing strategies that can be introduced into any high performance computing application without requiring additional analysis or significant software alterations is desirable. In this paper, we provide a contribution in this direction by proposing a general framework for designing error bounded approximate computing strategies and apply it to the dot product kernel to develop qdot an error bounded approximate dot product kernel. Following the introduction of qdot, we perform a theoretical analysis that yields a deterministic bound on the relative approximation error introduced by qdot. Empirical tests are performed to illustrate the tightness of the derived error bound and to demonstrate the effectiveness of qdot on a synthetic dataset, as well as two scientific benchmarks Conjugate Gradient (CG) and the Power method. In particular, using qdot for the dot products in CG can result in a majority of components being perforated or quantized to half precision without increasing the iteration count required for convergence to the same solution as CG using a double precision dot product.


SAT Based Analogy Evaluation Framework for Persian Word Embeddings. In recent years there has been a special interest in word embeddings as a new approach to convert words to vectors. It has been a focal point to understand how much of the semantics of the the words has been transferred into embedding vectors. This is important as the embedding is going to be used as the basis for downstream NLP applications and it will be costly to evaluate the application end to end in order to identify quality of the used embedding model. Generally the word embeddings are evaluated through a number of tests, including analogy test. In this paper we propose a test framework for Persian embedding models. Persian is a low resource language and there is no rich semantic benchmark to evaluate word embedding models for this language. In this paper we introduce an evaluation framework including a hand crafted Persian SAT based analogy dataset, a colliquial test set (specific to Persian) and a benchmark to study the impact of various parameters on the semantic evaluation task.


A product forcing model in which the Russell nontypical sets satisfy ZFC strictly between HOD and the universe. A set is nontypical in the Russell sense, if it belongs to a countable ordinal definable set. The class HNT of all hereditarily nontypical sets satisfies all axioms of ZF and the double inclusion HOD subseteq HNT subseteq V holds. Solving a problem recently proposed by Tzouvaras, a generic extension L a,x of L, by two reals a,x , is presented in which L HOD subsetneqq L a HNT subsetneqq V L a,x , so that HNT is a model of ZFC strictly between HOD and the universe.


Predicting the Popularity of Reddit Posts with AI. Social media creates crucial mass changes, as popular posts and opinions cast a significant influence on users' decisions and thought processes. For example, the recent Reddit uprising inspired by r wallstreetbets which had remarkable economic impact was started with a series of posts on the thread. The prediction of posts that may have a notable impact will allow for the preparation of possible following trends. This study aims to develop a machine learning model capable of accurately predicting the popularity of a Reddit post. Specifically, the model is predicting the number of upvotes a post will receive based on its textual content. I experimented with three different models a baseline linear regression model, a random forest regression model, and a neural network. I collected Reddit post data from an online data set and analyzed the model's performance when trained on a single subreddit and a collection of subreddits. The results showed that the neural network model performed the best when the loss of the models were compared. With the use of a machine learning model to predict social trends through the reaction users have to post, a better picture of the near future can be envisioned.


A uniform Chevalley theorem for direct summands of polynomial rings in mixed characteristic. We prove an explicit uniform Chevalley theorem for direct summands of graded polynomial rings in mixed characteristic. Our strategy relies on the introduction of a new type of differential powers, which do not require the existence of a p derivation on the direct summand.


MULLS Versatile LiDAR SLAM via Multi metric Linear Least Square. The rapid development of autonomous driving and mobile mapping calls for off the shelf LiDAR SLAM solutions that are adaptive to LiDARs of different specifications on various complex scenarios. To this end, we propose MULLS, an efficient, low drift, and versatile 3D LiDAR SLAM system. For the front end, roughly classified feature points (ground, facade, pillar, beam, etc.) are extracted from each frame using dual threshold ground filtering and principal components analysis. Then the registration between the current frame and the local submap is accomplished efficiently by the proposed multi metric linear least square iterative closest point algorithm. Point to point (plane, line) error metrics within each point class are jointly optimized with a linear approximation to estimate the ego motion. Static feature points of the registered frame are appended into the local map to keep it updated. For the back end, hierarchical pose graph optimization is conducted among regularly stored history submaps to reduce the drift resulting from dead reckoning. Extensive experiments are carried out on three datasets with more than 100,000 frames collected by seven types of LiDAR on various outdoor and indoor scenarios. On the KITTI benchmark, MULLS ranks among the top LiDAR only SLAM systems with real time performance.


On Ahlfors currents. We answer a basic question in Nevanlinna theory that Ahlfors currents associated to the same entire curve may be nonunique. Indeed, we will construct one exotic entire curve f mathbb C rightarrow X which produces infinitely many cohomologically different Ahlfors currents. Moreover, concerning Siu's decomposition, for an arbitrary k in mathbb Z cup infty , some of the obtained Ahlfors currents have singular parts supported on k irreducible curves. In addition, they can have nonzero diffuse parts as well. Lastly, we provide new examples of diffuse Ahlfors currents on the product of two elliptic curves and on mathbb P 2( mathbb C ) , and we show cohomologically elaborate Ahlfors currents on blow ups of X .


Fast Newton Iterative Method for Local Steric Poisson Boltzmann Theories in Biomolecular Solvation. This work proposes a fast iterative method for local steric Poisson Boltzmann (PB) theories, in which the electrostatic potential is governed by the Poisson's equation and ionic concentrations satisfy equilibrium conditions. To present the method, we focus on a local steric PB theory derived from a lattice gas model, as an example. The advantages of the proposed method in efficiency lies on a key idea that ionic concentrations as scalar implicit functions of the electrostatic potential, i.e, generalized Boltzmann distributions, are numerically available. The existence, uniqueness, boundness, and smoothness of such distributions are rigorously established. A Newton iteration method with truncation is proposed to solve a nonlinear system discretized from the generalized PB equations. The existence and uniqueness of the solution to the discretized nonlinear system are established by showing that it is a unique minimizer of a constructed convex energy. Thanks to the boundness of ionic concentrations, truncation bounds for the potential are obtained by using the extremum principle. The truncation step in iterations is shown to be energy, residual, and error decreasing. To further speed up computations, we propose a novel precomputing interpolation strategy, which is applicable to other local steric PB theories and makes the proposed methods for solving steric PB theories as efficient as for solving the classical PB theory. Analysis on the Newton iteration method with truncation shows local quadratic convergence for the proposed numerical methods. Applications to realistic biomolecular solvation systems reveal that counterions with steric hindrance stratify in an order prescribed by the parameter of ionic valence to volume ratio. Finally, we remark that the proposed iterative methods for local steric PB theories can be readily incorporated in well known classical PB solvers.


Piecewise Interaction Picture Density Matrix Quantum Monte Carlo. The density matrix quantum Monte Carlo (DMQMC) set of methods stochastically samples the exact N body density matrix for interacting electrons at finite temperature. We introduce a simple modification to the interaction picture DMQMC method (IP DMQMC) which overcomes the limitation of only sampling one inverse temperature point at a time, instead allowing for the sampling of a temperature range within a single calculation thereby reducing the computational cost. At the target inverse temperature, instead of ending the simulation, we incorporate a change of picture away from the interaction picture. The resulting equations of motion have piecewise functions and use the interaction picture in the first phase of a simulation, followed by the application of the Bloch equation once the target inverse temperature is reached. We find that the performance of this method is similar to or better than the DMQMC and IP DMQMC algorithms in a variety of molecular test systems.


Note on the Kato property of sectorial forms. We characterise the Kato property of a sectorial form mathfrak a , defined on a Hilbert space V , with respect to a larger Hilbert space H in terms of two bounded, selfadjoint operators T and Q determined by the imaginary part of mathfrak a and the embedding of V into H , respectively. As a consequence, we show that if a bounded selfadjoint operator T on a Hilbert space V is in the Schatten class S p(V) ( p geq 1 ), then the associated form mathfrak a T( cdot, cdot) langle (I iT) cdot , cdot rangle V has the Kato property with respect to every Hilbert space H into which V is densely and continuously embedded. This result is in a sense sharp. Another result says that if T and Q commute then the form mathfrak a with respect to H possesses the Kato property.


SeqScore Addressing Barriers to Reproducible Named Entity Recognition Evaluation. To address a looming crisis of unreproducible evaluation for named entity recognition, we propose guidelines and introduce SeqScore, a software package to improve reproducibility. The guidelines we propose are extremely simple and center around transparency regarding how chunks are encoded and scored. We demonstrate that despite the apparent simplicity of NER evaluation, unreported differences in the scoring procedure can result in changes to scores that are both of noticeable magnitude and statistically significant. We describe SeqScore, which addresses many of the issues that cause replication failures.


Tilted Corners in Integer Grids. It was proved by Ron Graham and the second author that for any coloring of the N times N grid using fewer than log log N colours, one can always find a monochromatic isosceles right triangle, a triangle with vertex coordinates (x, y),(x d, y), and (x, y d). In this paper we are asking questions where not only axis parallel, but tilted isosceles right triangles are considered as well. Both colouring and density variants of the problem will be discussed.


Finite Model Theory of the Triguarded Fragment and Related Logics. The Triguarded Fragment (TGF) is among the most expressive decidable fragments of first order logic, subsuming both its two variable and guarded fragments without equality. We show that the TGF has the finite model property (providing a tight doubly exponential bound on the model size) and hence finite satisfiability coincides with satisfiability known to be N2ExpTime complete. Using similar constructions, we also establish 2ExpTime completeness for finite satisfiability of the constant free (tri)guarded fragment with transitive guards.


Zeros with multiplicity, Hasse derivatives and linear factors of general skew polynomials. In this work, multiplicities of zeros of general skew polynomials are studied. Two distinct definitions are considered First, a is said to be a zero of F of multiplicity r if (x a) r divides F on the right second, a is said to be a zero of F of multiplicity r if some skew polynomial P (x a r) cdots (x a 2) (x a 1) , having a 1 a as its only right zero, divides F on the right. The first notion was considered earlier, while the second one was recently introduced by Bolotnikov over the quaternions. Neither of these two notions implies the other for general skew polynomials. We show that, in the first case, Lam and Leroy's concept of P independence does not behave naturally, whereas a union theorem, as stated by Lam, still holds. In contrast, we show that P independence for the second notion of multiplicities behaves naturally. As a consequence, we provide extensions of classical commutative results to general skew polynomials. These include the upper bound on the number of (P independent) zeros (counting multiplicities) of a skew polynomial by its degree, and the equivalence of P independence, the solvability of Hermite interpolation and the invertibility of confluent Vandermonde matrices (for which we introduce skew polynomial Hasse derivatives). We provide characterizations of skew polynomials of the form P (x a r) cdots (x a 2) (x a 1) having a single right zero, assuming conjugacy classes are algebraic. Based on these, we explicitly describe such skew polynomials in particular cases of interest, recovering Bolotnikov's results over the quaternions as a particular case.


Effective uniform approximation by L functions in the Selberg class. Recently, Garunk v s tis, Laurin v c ikas, Matsumoto, J. R. Steuding showed an effective universality type theorem for the Riemann zeta function by using an effective multi dimensional denseness result of Voronin. We will generalize Voronin's effective result and their theorem to the elements of the Selberg class satisfying some conditions.


Tracial oscillation zero and stable rank one. Let A be a separable (not necessarily unital) simple C algebra with strict comparison. We show that if A has tracial approximate oscillation zero then A has stable rank one and the canonical map Gamma from the Cuntz semigroup of A to the corresponding affine function space is surjective. The converse also holds. As a by product, we find that a separable simple C algebra which has almost stable rank one must have stable rank one, provided it has strict comparison and the canonical map Gamma is surjective.


Double Flag Varieties and Representations of Quivers. We gave a classification of P and Q with a finite number of K orbits of a double flag variety G P K Q for a symmetric pair (G, K) when G GL m n and K GL m GL n , and a description of K orbits when the number of K orbits of G P K Q is finite. We solved the problem by providing a correspondence between the K orbits and the quiver representations.


Some basic results on finite linear recurring sequence subgroups. An f subgroup is a linear recurring sequence subgroup, a multiplicative subgroup of a field whose elements can be generated (without repetition) by a linear recurrence relation, with characteristic polynomial f . It is called non standard if it can be generated in a non cyclic way (that is, not in the order alpha i, alpha i 1 , alpha i 2 ldots for a zero alpha of f ), and standard otherwise. We will show that a finite f subgroup is necessarily generated by a subset of the zeros of f . We use this result to improve on a recent theorem of Brison and Nogueira. A old question by Brison and Nogueira asks if there exist automatically non standard f subgroups, f subgroups that cannot be generated by a zero of f . We answer that question affirmatively by constructing infinitely many examples.


Opportunistic Spectrum Access Does Maximizing Throughput Minimize File Transfer Time?. The Opportunistic Spectrum Access (OSA) model has been developed for the secondary users (SUs) to exploit the stochastic dynamics of licensed channels for file transfer in an opportunistic manner. Common approaches to design channel sensing strategies for throughput oriented applications tend to maximize the long term throughput, with the hope that it provides reduced file transfer time as well. In this paper, we show that this is not correct in general, especially for small files. Unlike prior delay related works that seldom consider the heterogeneous channel rate and bursty incoming packets, our work explicitly considers minimizing the file transfer time of a single file consisting of multiple packets in a set of heterogeneous channels. We formulate a mathematical framework for the static policy, and extend to dynamic policy by mapping our file transfer problem to the stochastic shortest path problem. We analyze the performance of our proposed static optimal and dynamic optimal policies over the policy that maximizes long term throughput. We then propose a heuristic policy that takes into account the performance complexity tradeoff and an extension to online implementation with unknown channel parameters, and also present the regret bound for our online algorithm. We also present numerical simulations that reflect our analytical results.


Data Driven Design by Analogy State of the Art and Future Directions. Design by Analogy (DbA) is a design methodology wherein new solutions, opportunities or designs are generated in a target domain based on inspiration drawn from a source domain it can benefit designers in mitigating design fixation and improving design ideation outcomes. Recently, the increasingly available design databases and rapidly advancing data science and artificial intelligence technologies have presented new opportunities for developing data driven methods and tools for DbA support. In this study, we survey existing data driven DbA studies and categorize individual studies according to the data, methods, and applications in four categories, namely, analogy encoding, retrieval, mapping, and evaluation. Based on both nuanced organic review and structured analysis, this paper elucidates the state of the art of data driven DbA research to date and benchmarks it with the frontier of data science and AI research to identify promising research opportunities and directions for the field. Finally, we propose a future conceptual data driven DbA system that integrates all propositions.


Texture synthesis via projection onto multiscale, multilayer statistics. We provide a new model for texture synthesis based on a multiscale, multilayer feature extractor. Within the model, textures are represented by a set of statistics computed from ReLU wavelet coefficients at different layers, scales and orientations. A new image is synthesized by matching the target statistics via an iterative projection algorithm. We explain the necessity of the different types of pre defined wavelet filters used in our model and the advantages of multilayer structures for image synthesis. We demonstrate the power of our model by generating samples of high quality textures and providing insights into deep representations for texture images.


Phi contractive parent child infinite IFSs and orbital phi contractive infinite IFSs. In this paper we introduce the notions of phi contractive parent child infinite iterated function system (pcIIFS) and orbital phi contractive infinite iterated function system (oIIFS) and we prove that the corresponding fractal operator is weakly Picard. The corresponding notions of shift space, canonical projection and their properties are also treated.


The v C erny Conjecture for aperiodic automata. A word w is called a synchronizing (recurrent, reset) word of a deterministic finite automaton (DFA) if w brings all states of the automaton to some state a DFA that has a synchronizing word is said to be synchronizing. Cerny conjectured in 1964 that every n state synchronizing DFA possesses a synchronizing word of length at most (n 1)2. We consider automaton with aperiodic transition monoid (such automaton is called aperiodic). We show that every synchronizing n state aperiodic automaton has a synchronizing word of length at most n(n 2) 1. Thus, for aperiodic automaton as well as for automatons accepting only star free languages, the Cerny conjecture holds true.


Thermal Infrared Image Colorization for Nighttime Driving Scenes with Top Down Guided Attention. Benefitting from insensitivity to light and high penetration of foggy environments, infrared cameras are widely used for sensing in nighttime traffic scenes. However, the low contrast and lack of chromaticity of thermal infrared (TIR) images hinder the human interpretation and portability of high level computer vision algorithms. Colorization to translate a nighttime TIR image into a daytime color (NTIR2DC) image may be a promising way to facilitate nighttime scene perception. Despite recent impressive advances in image translation, semantic encoding entanglement and geometric distortion in the NTIR2DC task remain under addressed. Hence, we propose a toP down attEntion And gRadient aLignment based GAN, referred to as PearlGAN. A top down guided attention module and an elaborate attentional loss are first designed to reduce the semantic encoding ambiguity during translation. Then, a structured gradient alignment loss is introduced to encourage edge consistency between the translated and input images. In addition, pixel level annotation is carried out on a subset of FLIR and KAIST datasets to evaluate the semantic preservation performance of multiple translation methods. Furthermore, a new metric is devised to evaluate the geometric consistency in the translation process. Extensive experiments demonstrate the superiority of the proposed PearlGAN over other image translation methods for the NTIR2DC task. The source code and labeled segmentation masks will be available at url https github.com FuyaLuo PearlGAN .


On simultaneous linearization of certain commuting nearly integrable diffeomorphisms of the cylinder. Let mathcal F and mathcal K be commuting C infty diffeomorphisms of the cylinder mathbb T times mathbb R that are, respectively, close to mathcal F 0 (x, y) (x omega(y), y) and T alpha (x, y) (x alpha, y) , where omega(y) is non degenerate and alpha is Diophantine. Using the KAM iterative scheme for the group action we show that mathcal F and mathcal K are simultaneously C infty linearizable if mathcal F has the intersection property (including the exact symplectic maps) and mathcal K satisfies a semi conjugacy condition. We also provide examples showing necessity of these conditions. As a consequence, we get local rigidity of certain class of mathbb Z 2 actions on the cylinder, generated by commuting twist maps.


Customer 360 degree Insights in Predicting Chronic Diabetes. Chronic diseases such as diabetes are quite prevalent in the world and are responsible for a significant number of deaths per year. In addition, treatments for such chronic diseases account for a high healthcare cost. However, research has shown that diabetes can be proactively managed and prevented while lowering these healthcare costs. We have mined a sample of ten million customers' 360 degree data representing the state of Texas, USA, with attributes current as of late 2018. The sample received from a market research data vendor has over 1000 customer attributes consisting of demography, lifestyle, and in some cases self reported chronic conditions. In this study, we have developed a classification model to predict chronic diabetes with an accuracy of 80 . We demonstrate a use case where a large volume of 360 degree customer data can be useful to predict and hence proactively prevent chronic diseases such as diabetes.


Phase bounded finite element method for two fluid incompressible flow systems. An understanding of the hydrodynamics of multiphase processes is essential for their design and operation. Multiphase computational fluid dynamics (CFD) simulations enable researchers to gain insight which is inaccessible experimentally. The model frequently used to simulate these processes is the two fluid (Euler Euler) model where fluids are treated as inter penetrating continua. It is formulated for the multiphase flow regime where one phase is dispersed within another and enables simulation on experimentally relevant scales. Phase fractions are used to describe the composition of the mixture and are bounded quantities. Consequently, numerical solution methods used in simulations must preserve boundedness for accuracy and physical fidelity. In this work, a numerical method for the two fluid model is developed in which phase fraction constraints are imposed through the use of an nonlinear variational inequality solver which implicitly imposes inequality constraints. The numerical method is verified and compared to an established explicit numerical method.


Unbounded multipliers of complete Pick spaces. We examine densely defined (but possibly unbounded) multiplication operators in Hilbert function spaces possessing a complete Nevanlinna Pick (CNP) kernel. For such a densely defined operator T , the domains of T and T are reproducing kernel Hilbert spaces contractively contained in the ambient space. We study several aspects of these spaces, especially the domain of T , which can be viewed as analogs of the classical deBranges Rovnyak spaces in the unit disk.


A modular vision language navigation and manipulation framework for long horizon compositional tasks in indoor environment. In this paper we propose a new framework MoViLan (Modular Vision and Language) for execution of visually grounded natural language instructions for day to day indoor household tasks. While several data driven, end to end learning frameworks have been proposed for targeted navigation tasks based on the vision and language modalities, performance on recent benchmark data sets revealed the gap in developing comprehensive techniques for long horizon, compositional tasks (involving manipulation and navigation) with diverse object categories, realistic instructions and visual scenarios with non reversible state changes. We propose a modular approach to deal with the combined navigation and object interaction problem without the need for strictly aligned vision and language training data (e.g., in the form of expert demonstrated trajectories). Such an approach is a significant departure from the traditional end to end techniques in this space and allows for a more tractable training process with separate vision and language data sets. Specifically, we propose a novel geometry aware mapping technique for cluttered indoor environments, and a language understanding model generalized for household instruction following. We demonstrate a significant increase in success rates for long horizon, compositional tasks over the baseline on the recently released benchmark data set ALFRED.


Learning to Detect Adversarial Examples Based on Class Scores. Given the increasing threat of adversarial attacks on deep neural networks (DNNs), research on efficient detection methods is more important than ever. In this work, we take a closer look at adversarial attack detection based on the class scores of an already trained classification model. We propose to train a support vector machine (SVM) on the class scores to detect adversarial examples. Our method is able to detect adversarial examples generated by various attacks, and can be easily adopted to a plethora of deep classification models. We show that our approach yields an improved detection rate compared to an existing method, whilst being easy to implement. We perform an extensive empirical analysis on different deep classification models, investigating various state of the art adversarial attacks. Moreover, we observe that our proposed method is better at detecting a combination of adversarial attacks. This work indicates the potential of detecting various adversarial attacks simply by using the class scores of an already trained classification model.


AutoDS Towards Human Centered Automation of Data Science. Data science (DS) projects often follow a lifecycle that consists of laborious tasks for data scientists and domain experts (e.g., data exploration, model training, etc.). Only till recently, machine learning(ML) researchers have developed promising automation techniques to aid data workers in these tasks. This paper introduces AutoDS, an automated machine learning (AutoML) system that aims to leverage the latest ML automation techniques to support data science projects. Data workers only need to upload their dataset, then the system can automatically suggest ML configurations, preprocess data, select algorithm, and train the model. These suggestions are presented to the user via a web based graphical user interface and a notebook based programming user interface. We studied AutoDS with 30 professional data scientists, where one group used AutoDS, and the other did not, to complete a data science project. As expected, AutoDS improves productivity Yet surprisingly, we find that the models produced by the AutoDS group have higher quality and less errors, but lower human confidence scores. We reflect on the findings by presenting design implications for incorporating automation techniques into human work in the data science lifecycle.


DeepReduce A Sparse tensor Communication Framework for Distributed Deep Learning. Sparse tensors appear frequently in distributed deep learning, either as a direct artifact of the deep neural network's gradients, or as a result of an explicit sparsification process. Existing communication primitives are agnostic to the peculiarities of deep learning consequently, they impose unnecessary communication overhead. This paper introduces DeepReduce, a versatile framework for the compressed communication of sparse tensors, tailored for distributed deep learning. DeepReduce decomposes sparse tensors in two sets, values and indices, and allows both independent and combined compression of these sets. We support a variety of common compressors, such as Deflate for values, or run length encoding for indices. We also propose two novel compression schemes that achieve superior results curve fitting based for values and bloom filter based for indices. DeepReduce is orthogonal to existing gradient sparsifiers and can be applied in conjunction with them, transparently to the end user, to significantly lower the communication overhead. As proof of concept, we implement our approach on Tensorflow and PyTorch. Our experiments with large real models demonstrate that DeepReduce transmits fewer data and imposes lower computational overhead than existing methods, without affecting the training accuracy.


kMatrix A Space Efficient Streaming Graph Summarization Technique. The amount of collected information on data repositories has vastly increased with the advent of the internet. It has become increasingly complex to deal with these massive data streams due to their sheer volume and the throughput of incoming data. Many of these data streams are mapped into graphs, which helps discover some of their properties. However, due to the difficulty in processing massive streaming graphs, they are summarized such that their properties can be approximately evaluated using the summaries. gSketch, TCM, and gMatrix are some of the major streaming graph summarization techniques. Our primary contribution is devising kMatrix, which is much more memory efficient than existing streaming graph summarization techniques. We achieved this by partitioning the allocated memory using a sample of the original graph stream. Through the experiments, we show that kMatrix can achieve a significantly less error for the queries using the same space as that of TCM and gMatrix.


Pi NAS Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift. Recently proposed neural architecture search (NAS) methods co train billions of architectures in a supernet and estimate their potential accuracy using the network weights detached from the supernet. However, the ranking correlation between the architectures' predicted accuracy and their actual capability is incorrect, which causes the existing NAS methods' dilemma. We attribute this ranking correlation problem to the supernet training consistency shift, including feature shift and parameter shift. Feature shift is identified as dynamic input distributions of a hidden layer due to random path sampling. The input distribution dynamic affects the loss descent and finally affects architecture ranking. Parameter shift is identified as contradictory parameter updates for a shared layer lay in different paths in different training steps. The rapidly changing parameter could not preserve architecture ranking. We address these two shifts simultaneously using a nontrivial supernet Pi model, called Pi NAS. Specifically, we employ a supernet Pi model that contains cross path learning to reduce the feature consistency shift between different paths. Meanwhile, we adopt a novel nontrivial mean teacher containing negative samples to overcome parameter shift and model collision. Furthermore, our Pi NAS runs in an unsupervised manner, which can search for more transferable architectures. Extensive experiments on ImageNet and a wide range of downstream tasks (e.g., COCO 2017, ADE20K, and Cityscapes) demonstrate the effectiveness and universality of our Pi NAS compared to supervised NAS. See Codes https github.com Ernie1 Pi NAS.


Error Diagnosis of Deep Monocular Depth Estimation Models. Estimating depth from a monocular image is an ill posed problem when the camera projects a 3D scene onto a 2D plane, depth information is inherently and permanently lost. Nevertheless, recent work has shown impressive results in estimating 3D structure from 2D images using deep learning. In this paper, we put on an introspective hat and analyze state of the art monocular depth estimation models in indoor scenes to understand these models' limitations and error patterns. To address errors in depth estimation, we introduce a novel Depth Error Detection Network (DEDN) that spatially identifies erroneous depth predictions in the monocular depth estimation models. By experimenting with multiple state of the art monocular indoor depth estimation models on multiple datasets, we show that our proposed depth error detection network can identify a significant number of errors in the predicted depth maps. Our module is flexible and can be readily plugged into any monocular depth prediction network to help diagnose its results. Additionally, we propose a simple yet effective Depth Error Correction Network (DECN) that iteratively corrects errors based on our initial error diagnosis.