On the efficient parallel computing of long term reliable trajectories for the Lorenz system. In this work we propose an efficient parallelization of multiple precision Taylor series method with variable stepsize and fixed order. For given level of accuracy the optimal variable stepsize determines higher order of the method than in the case of optimal fixed stepsize. Although the used order of the method is greater then that in the case of fixed stepsize, and hence the computational work per step is greater, the reduced number of steps gives less overall work. Also the greater order of the method is beneficial in the sense that it increases the parallel efficiency. As a model problem we use the paradigmatic Lorenz system. With 256 CPU cores in Nestum cluster, Sofia, Bulgaria, we succeed to obtain a correct reference solution in the rather long time interval 0,11000 . To get this solution we performed two large computations one computation with 4566 decimal digits of precision and 5240 th order method, and second computation for verification with 4778 decimal digits of precision and 5490 th order method.


A resolution of singularities of Drinfeld compactification with an Iwahori structure. This paper considers a tiny modification of Justin Campbell's construction of the Kontsevich compactification in cite Camp . We construct a resolution of singularities of Drinfeld compactification with an Iwahori structure and use it to prove the universally local acyclity of ! extension D module on the Drinfeld compactification with an Iwahori structure.


Image scaling by de la Vall 'ee Poussin filtered interpolation. We present a new image scaling method both for downscaling and upscaling, running with any scale factor or desired size. It is based on the sampling of an approximating bivariate polynomial, which globally interpolates the data and is defined by a filter of de la Vall 'ee Poussin type whose action ray is suitable regulated to improve the approximation. The method has been tested on a significant number of different image datasets. The results are evaluated in qualitative and quantitative terms and compared with other available competitive methods. The perceived quality of the resulting scaled images is such that important details are preserved, and the appearance of artifacts is low. Very high quality measure values in downscaling and the competitive ones in upscaling evidence the effectiveness of the method. Good visual quality, limited computational effort, and moderate memory demanding make the method suitable for real world applications.


Classification based Quality Estimation Small and Efficient Models for Real world Applications. Sentence level Quality estimation (QE) of machine translation is traditionally formulated as a regression task, and the performance of QE models is typically measured by Pearson correlation with human labels. Recent QE models have achieved previously unseen levels of correlation with human judgments, but they rely on large multilingual contextualized language models that are computationally expensive and make them infeasible for real world applications. In this work, we evaluate several model compression techniques for QE and find that, despite their popularity in other NLP tasks, they lead to poor performance in this regression setting. We observe that a full model parameterization is required to achieve SoTA results in a regression task. However, we argue that the level of expressiveness of a model in a continuous range is unnecessary given the downstream applications of QE, and show that reframing QE as a classification problem and evaluating QE models using classification metrics would better reflect their actual performance in real world applications.


Continuation Path with Linear Convergence Rate. Path following algorithms are frequently used in composite optimization problems where a series of subproblems, with varying regularization hyperparameters, are solved sequentially. By reusing the previous solutions as initialization, better convergence speeds have been observed numerically. This makes it a rather useful heuristic to speed up the execution of optimization algorithms in machine learning. We present a primal dual analysis of the path following algorithm and explore how to design its hyperparameters as well as determining how accurately each subproblem should be solved to guarantee a linear convergence rate on a target problem. Furthermore, considering optimization with a sparsity inducing penalty, we analyze the change of the active sets with respect to the regularization parameter. The latter can then be adaptively calibrated to finely determine the number of features that will be selected along the solution path. This leads to simple heuristics for calibrating hyperparameters of active set approaches to reduce their complexity and improve their execution time.


Cyclic Coordinate Dual Averaging with Extrapolation for Generalized Variational Inequalities. Cyclic block coordinate methods are a fundamental class of optimization methods widely used in practice and implemented as part of standard software packages for statistical learning. Nevertheless, their convergence is generally not well understood and so far their good practical performance has not been explained by existing convergence analyses. In this work, we introduce a new block coordinate method that applies to the general class of variational inequality (VI) problems with monotone operators. This class includes composite convex optimization problems and convex concave min max optimization problems as special cases and has not been addressed by the existing work. The resulting convergence bounds match the optimal convergence bounds of full gradient methods, but are provided in terms of a novel gradient Lipschitz condition w.r.t. a Mahalanobis norm. For m coordinate blocks, the resulting gradient Lipschitz constant in our bounds is never larger than a factor sqrt m compared to the traditional Euclidean Lipschitz constant, while it is possible for it to be much smaller. Further, for the case when the operator in the VI has finite sum structure, we propose a variance reduced variant of our method which further decreases the per iteration cost and has better convergence rates in certain regimes. To obtain these results, we use a gradient extrapolation strategy that allows us to view a cyclic collection of block coordinate wise gradients as one implicit gradient.


Self Supervised Disentangled Representation Learning for Third Person Imitation Learning. Humans learn to imitate by observing others. However, robot imitation learning generally requires expert demonstrations in the first person view (FPV). Collecting such FPV videos for every robot could be very expensive. Third person imitation learning (TPIL) is the concept of learning action policies by observing other agents in a third person view (TPV), similar to what humans do. This ultimately allows utilizing human and robot demonstration videos in TPV from many different data sources, for the policy learning. In this paper, we present a TPIL approach for robot tasks with egomotion. Although many robot tasks with ground aerial mobility often involve actions with camera egomotion, study on TPIL for such tasks has been limited. Here, FPV and TPV observations are visually very different FPV shows egomotion while the agent appearance is only observable in TPV. To enable better state learning for TPIL, we propose our disentangled representation learning method. We use a dual auto encoder structure plus representation permutation loss and time contrastive loss to ensure the state and viewpoint representations are well disentangled. Our experiments show the effectiveness of our approach.


Non Dissipative and Structure Preserving Emulators via Spherical Optimization. Approximating a function with a finite series, e.g., involving polynomials or trigonometric functions, is a critical tool in computing and data analysis. The construction of such approximations via now standard approaches like least squares or compressive sampling does not ensure that the approximation adheres to certain convex linear structural constraints, such as positivity or monotonicity. Existing approaches that ensure such structure are norm dissipative and this can have a deleterious impact when applying these approaches, e.g., when numerical solving partial differential equations. We present a new framework that enforces via optimization such structure on approximations and is simultaneously norm preserving. This results in a conceptually simple convex optimization problem on the sphere, but the feasible set for such problems can be very complex. We establish well posedness of the optimization problem through results on spherical convexity and design several spherical projection based algorithms to numerically compute the solution. Finally, we demonstrate the effectiveness of this approach through several numerical examples.


Study of Robust Adaptive Beamforming Based on Low Complexity DFT Spatial Sampling. In this paper, a novel and robust algorithm is proposed for adaptive beamforming based on the idea of reconstructing the autocorrelation sequence (ACS) of a random process from a set of measured data. This is obtained from the first column and the first row of the sample covariance matrix (SCM) after averaging along its diagonals. Then, the power spectrum of the correlation sequence is estimated using the discrete Fourier transform (DFT). The DFT coefficients corresponding to the angles within the noise plus interference region are used to reconstruct the noise plus interference covariance matrix (NPICM), while the desired signal covariance matrix (DSCM) is estimated by identifying and removing the noise plus interference component from the SCM. In particular, the spatial power spectrum of the estimated received signal is utilized to compute the correlation sequence corresponding to the noise plus interference in which the dominant DFT coefficient of the noise plus interference is captured. A key advantage of the proposed adaptive beamforming is that only little prior information is required. Specifically, an imprecise knowledge of the array geometry and of the angular sectors in which the interferences are located is needed. Simulation results demonstrate that compared with previous reconstruction based beamformers, the proposed approach can achieve better overall performance in the case of multiple mismatches over a very large range of input signal to noise ratios.


Weakly Supervised Object Localization and Detection A Survey. As an emerging and challenging problem in the computer vision community, weakly supervised object localization and detection plays an important role for developing new generation computer vision systems and has received significant attention in the past decade. As methods have been proposed, a comprehensive survey of these topics is of great importance. In this work, we review (1) classic models, (2) approaches with feature representations from off the shelf deep networks, (3) approaches solely based on deep learning, and (4) publicly available datasets and standard evaluation metrics that are widely used in this field. We also discuss the key challenges in this field, development history of this field, advantages disadvantages of the methods in each category, the relationships between methods in different categories, applications of the weakly supervised object localization and detection methods, and potential future directions to further promote the development of this research field.


Stochastic differential equations with irregular coefficients mind the gap!. Numerical methods for stochastic differential equations with non globally Lipschitz coefficients are currently studied intensively. This article gives an overview of our work for the case that the drift coefficient is potentially discontinuous complemented by other important results in this area. To make the topic accessible to a broad audience, we begin with a heuristic on SDEs and a motivation.


Aberrated optical cavities. Optical cavities are an enabling technology of modern quantum science from their essential role in the operation of lasers, to applications as fly wheels in atomic clocks and interaction enhancing components in quantum optics experiments, developing a quantitative understanding of the mode shapes and energies of optical cavities has been crucial for the growth of the field. Nonetheless, the standard treatment using paraxial, quadratic optics fails to capture the influence of optical aberrations present in modern cavities with high finesse, small waist, and or many degenerate modes. In this work, we compute the mode spectrum of optical resonators, allowing for both non paraxial beam propagation and beyond quadratic mirrors and lenses. Generalizing prior works 1 5 , we develop a complete theory of resonator aberrations, including intracavity lenses, non planar geometries, and arbitrary mirror forms. Harnessing these tools, we reconcile the near absence of aberration in Ref. 6 with the strongly evident aberrations in the seemingly similar cavity of Ref. 7 . We further validate our approach by comparison to a family of non planar lens cavities realized in the lab, finding good quantitative agreement. This work opens new prospects for cavities with smaller waists and more degenerate modes.


Convex Online Video Frame Subset Selection using Multiple Criteria for Data Efficient Autonomous Driving. Training vision based Urban Autonomous driving models is a challenging problem, which is highly researched in recent times. Training such models is a data intensive task requiring the storage and processing of vast volumes of (possibly redundant) driving video data. In this paper, we study the problem of developing data efficient autonomous driving systems. In this context, we study the problem of multi criteria online video frame subset selection. We study convex optimization based solutions and show that they are unable to provide solutions with high weightage to the loss of selected video frames. We design a novel convex optimization based multi criteria online subset selection algorithm that uses a thresholded concave function of selection variables. We also propose and study a submodular optimization based algorithm. Extensive experiments using the driving simulator CARLA show that we are able to drop 80 of the frames while succeeding to complete 100 of the episodes w.r.t. the model trained on 100 data, in the most difficult task of taking turns. This results in a training time of less than 30 compared to training on the whole dataset. We also perform detailed experiments on prediction performances of various affordances used by the Conditional Affordance Learning (CAL) model and show that our subset selection improves performance on the crucial affordance "Relative Angle" during turns.


Stability and selective extinction in complex mutualistic networks. We study species abundance in the empirical plant pollinator mutualistic networks exhibiting broad degree distributions, with uniform intra group competition assumed, by the Lotka Volterra equation. The stability of a fixed point is found to be identified by the signs of its non zero components and those of its neighboring fixed points. Taking the annealed approximation, we derive the non zero components to be formulated in terms of degrees and the rescaled interaction strengths, which lead us to find different stable fixed points depending on parameters, and we obtain the phase diagram. The selective extinction phase finds small degree species extinct and effective interaction reduced, maintaining stability and hindering the onset of instability. The non zero minimum species abundances from different empirical networks show data collapse when rescaled as predicted theoretically.


Event based MILP models for ride hailing applications. Ride hailing services require efficient optimization algorithms to simultaneously plan routes and pool users in shared rides. We consider a static dial a ride problem (DARP) where a series of origin destination requests have to be assigned to routes of a fleet of vehicles. Thereby, all requests have associated time windows for pick up and delivery, and may be denied if they can not be serviced in reasonable time or at reasonable cost. Rather than using a spatial representation of the transportation network we suggest an event based formulation of the problem. While the corresponding MILP formulations require more variables than standard models, they have the advantage that capacity, pairing and precedence constraints are handled implicitly. The approach is tested and validated using a standard IP solver on benchmark data from the literature. Moreover, the impact of, and the trade off between, different optimization goals is evaluated on a case study in the city of Wuppertal (Germany).


Multi objective Herglotz' variational principle and cooperative Hamilton Jacobi systems. We study a multi objective variational problem of Herglotz' type with cooperative linear coupling. We established the associated Euler Lagrange equations and the characteristic system for cooperative weakly coupled systems of Hamilton Jacobi equations. We also established the relation of the value functions of this variational problem with the viscosity solutions of cooperative weakly coupled systems of Hamilton Jacobi equations. Comparing to the previous work in stochastic frame, this approach affords a pure deterministic explanation of this problem under more general conditions. We also showed this approach is valid for general linearly coupling matrix for short time.


Greedy Step Off Policy Reinforcement Learning. Most of the policy evaluation algorithms are based on the theories of Bellman Expectation and Optimality Equation, which derive two popular approaches Policy Iteration (PI) and Value Iteration (VI). However, multi step bootstrapping is often at cross purposes with and off policy learning in PI based methods due to the large variance of multi step off policy correction. In contrast, VI based methods are naturally off policy but subject to one step learning.In this paper, we deduce a novel multi step Bellman Optimality Equation by utilizing a latent structure of multi step bootstrapping with the optimal value function. Via this new equation, we derive a new multi step value iteration method that converges to the optimal value function with exponential contraction rate mathcal O ( gamma n) but only linear computational complexity. Moreover, it can naturally derive a suite of multi step off policy algorithms that can safely utilize data collected by arbitrary policies without correction.Experiments reveal that the proposed methods are reliable, easy to implement and achieve state of the art performance on a series of standard benchmark datasets.


Convergence of the boundary integral method for interfacial Stokes flow. Boundary integral numerical methods are among the most accurate methods for interfacial Stokes flow, and are widely applied. They have the advantage that only the boundary of the domain must be discretized, which reduces the number of discretization points and allows the treatment of complicated interfaces. Despite their popularity, there is no analysis of the convergence of these methods for interfacial Stokes flow. In practice, the stability of discretizations of the boundary integral formulation can depend sensitively on details of the discretization and on the application of numerical filters. We present a convergence analysis of the boundary integral method for Stokes flow, focusing on a rather general method for computing the evolution of an elastic capsule, viscous drop, or inviscid bubble in 2D strain and shear flows. The analysis clarifies the role of numerical filters in practical computations.


Efficient and Generic Interactive Segmentation Framework to Correct Mispredictions during Clinical Evaluation of Medical Images. Semantic segmentation of medical images is an essential first step in computer aided diagnosis systems for many applications. However, given many disparate imaging modalities and inherent variations in the patient data, it is difficult to consistently achieve high accuracy using modern deep neural networks (DNNs). This has led researchers to propose interactive image segmentation techniques where a medical expert can interactively correct the output of a DNN to the desired accuracy. However, these techniques often need separate training data with the associated human interactions, and do not generalize to various diseases, and types of medical images. In this paper, we suggest a novel conditional inference technique for DNNs which takes the intervention by a medical expert as test time constraints and performs inference conditioned upon these constraints. Our technique is generic can be used for medical images from any modality. Unlike other methods, our approach can correct multiple structures simultaneously and add structures missed at initial segmentation. We report an improvement of 13.3, 12.5, 17.8, 10.2, and 12.4 times in user annotation time than full human annotation for the nucleus, multiple cells, liver and tumor, organ, and brain segmentation respectively. We report a time saving of 2.8, 3.0, 1.9, 4.4, and 8.6 fold compared to other interactive segmentation techniques. Our method can be useful to clinicians for diagnosis and post surgical follow up with minimal intervention from the medical expert. The source code and the detailed results are available here 1 .


PMIPv6 Integrated with MIH for Flow Mobility Management a Real Testbed with Simultaneous Multi Access in Heterogeneous Mobile Networks. The exponential growth of the number of multihomed mobile devices is changing the way how we can connect to the Internet. Our mobile devices are demanding for more network resources, in terms of traffic volume and QoS requirements. Unfortunately, it is very hard to a multihomed device to be simultaneously connected to the network through multiple links. The current work enhances the network access of multihomed devices agnostically to the deployed access technologies. This enhancement is achieved by using simultaneously all of the mobile devices interfaces, and by routing each individual data flow through the most convenient access technology. The proposed solution is only deployed at the network side and it extends Proxy Mobile IPv6 with flow mobility in a completely transparent way to mobile nodes. In fact, it gives particular attention to the handover mechanisms, by improving the detection and attachment of nodes in the network, with the inclusion of the IEEE 802.21 standard in the solution. This provides the necessary implementation and integration details to extend a network topology with femtocell devices. Each femtocell is equipped with various network interfaces supporting a diverse set of access technologies. There is also a decision entity that manages individually each data flow according to its QoS QoE requisites. The proposed solution has been developed and extensively tested with a real prototype. Evaluation results evidence that the overhead for using the solution is negligible as compared to the offered advantages such as the support of flow mobility, the fulfil of VoIP functional requisites, the session continuity in spite of flows mobility, its low overhead, its high scalability, and the complete transparency of the proposed solution to the user terminals.


Moving intervals for packing and covering. We study several problems on geometric packing and covering with movement. Given a family mathcal I of n intervals of kappa distinct lengths, and another interval B , can we pack the intervals in mathcal I inside B (respectively, cover B by the intervals in mathcal I ) by moving tau intervals and keeping the other sigma n tau intervals unmoved? We show that both packing and covering are W 1 hard with any one of kappa , tau , and sigma as single parameter, but are FPT with combined parameters kappa and tau . We also obtain improved polynomial time algorithms for packing and covering, including an O(n log 2 n) time algorithm for covering, when all intervals in mathcal I have the same length.


Improving the robustness and accuracy of biomedical language models through adversarial training. Deep transformer neural network models have improved the predictive accuracy of intelligent text processing systems in the biomedical domain. They have obtained state of the art performance scores on a wide variety of biomedical and clinical Natural Language Processing (NLP) benchmarks. However, the robustness and reliability of these models has been less explored so far. Neural NLP models can be easily fooled by adversarial samples, i.e. minor changes to input that preserve the meaning and understandability of the text but force the NLP system to make erroneous decisions. This raises serious concerns about the security and trust worthiness of biomedical NLP systems, especially when they are intended to be deployed in real world use cases. We investigated the robustness of several transformer neural language models, i.e. BioBERT, SciBERT, BioMed RoBERTa, and Bio ClinicalBERT, on a wide range of biomedical and clinical text processing tasks. We implemented various adversarial attack methods to test the NLP systems in different attack scenarios. Experimental results showed that the biomedical NLP models are sensitive to adversarial samples their performance dropped in average by 21 and 18.9 absolute percent on character level and word level adversarial noise, respectively. Conducting extensive adversarial training experiments, we fine tuned the NLP models on a mixture of clean samples and adversarial inputs. Results showed that adversarial training is an effective defense mechanism against adversarial noise the models robustness improved in average by 11.3 absolute percent. In addition, the models performance on clean data increased in average by 2.4 absolute present, demonstrating that adversarial training can boost generalization abilities of biomedical NLP systems.


An Update on the Existence of Kirkman Triple Systems with Subdesigns. A Kirkman triple system of order v , KTS (v) , is a resolvable Steiner triple system on v elements. In this paper, we investigate an open problem posed by Doug Stinson, namely the existence of KTS (v) which contain as a subdesign a Steiner triple system of order u , an STS (u) . We present several different constructions for designs of this form. As a consequence, we completely settle the extremal case v 2u 1 , for which a list of possible exceptions had remained for close to 30 years. Our new constructions also provide the first infinite classes for the more general problem. We reduce the other maximal case v 2u 3 to now three possible exceptions. In addition, we obtain results for other cases of the form v 2u w and also near v 3u . Our primary method introduces a new type of Kirkman frame which contains group divisible design subsystems. These subsystems can occur with different configurations, and we use two different varieties in our constructions.


A complexity of compact 3 manifold via immersed surfaces. We define an invariant, which we call surface complexity, of compact 3 manifolds by means of Dehn surfaces. The surface complexity is a natural number measuring how much the manifold is complicated. We prove that it fulfils interesting properties it is subadditive under connected sum and finite to one on mathbb P 2 irreducible and boundary irreducible manifolds without essential annuli and M "obius strips. Moreover, for these manifolds, it equals the minimal number of cubes in a cubulation of the manifold, except for the sphere, the ball, the projective space and the lens space mathbb L 4,1 , which have surface complexity zero. We will also give estimations of the surface complexity by means of ideal triangulations and Matveev complexity.


Deep Calibration of Interest Rates Model. For any financial institution it is a necessity to be able to apprehend the behavior of interest rates. Despite the use of Deep Learning that is growing very fastly, due to many reasons (expertise, ease of use, ...) classic rates models such as CIR, or the Gaussian family are still being used widely. We propose to calibrate the five parameters of the G2 model using Neural Networks. To achieve that, we construct synthetic data sets of parameters drawn uniformly from a reference set of parameters calibrated from the market. From those parameters, we compute Zero Coupon and Forward rates and their covariances and correlations. Our first model is a Fully Connected Neural network and uses only covariances and correlations. We show that covariances are more suited to the problem than correlations. The second model is a Convulutional Neural Network using only Zero Coupon rates with no transformation. The methods we propose perform very quickly (less than 0.3 seconds for 2 000 calibrations) and have low errors and good fitting.


Trust, Shared Understanding and Locus of Control in Mixed Initiative Robotic Systems. This paper investigates how trust, shared understanding between a human operator and a robot, and the Locus of Control (LoC) personality trait, evolve and affect Human Robot Interaction (HRI) in mixed initiative robotic systems. As such systems become more advanced and able to instigate actions alongside human operators, there is a shift from robots being perceived as a tool to being a team mate. Hence, the team oriented human factors investigated in this paper (i.e. trust, shared understanding, and LoC) can play a crucial role in efficient HRI. Here, we present the results from an experiment inspired by a disaster response scenario in which operators remotely controlled a mobile robot in navigation tasks, with either human initiative or mixed initiative control, switching dynamically between two different levels of autonomy teleoperation and autonomous navigation. Evidence suggests that operators trusted and developed an understanding of the robotic systems, especially in mixed initiative control, where trust and understanding increased over time, as operators became more familiar with the system and more capable of performing the task. Lastly, evidence and insights are presented on how LoC affects HRI.


Recent Deep Semi supervised Learning Approaches and Related Works. The author of this work proposes an overview of the recent semi supervised learning approaches and related works. Despite the remarkable success of neural networks in various applications, there exist few formidable constraints including the need for a large amount of labeled data. Therefore, semi supervised learning, which is a learning scheme in which the scarce labels and a larger amount of unlabeled data are utilized to train models (e.g., deep neural networks) is getting more important. Based on the key assumptions of semi supervised learning, which are the manifold assumption, cluster assumption, and continuity assumption, the work reviews the recent semi supervised learning approaches. In particular, the methods in regard to using deep neural networks in a semi supervised learning setting are primarily discussed. In addition, the existing works are first classified based on the underlying idea and explained, and then the holistic approaches that unify the aforementioned ideas are detailed.


A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms. Abstract syntax tree (AST) mapping algorithms are widely used to analyze changes in source code. Despite the foundational role of AST mapping algorithms, little effort has been made to evaluate the accuracy of AST mapping algorithms, i.e., the extent to which an algorihtm captures the evolution of code. We observe that a program element often has only one best mapped program element. Based on this observation, we propose a hierarchical approach to automatically compare the similarity of mapped statements and tokens by different algorithms. By performing the comparison, we determine if each of the compared algorithms generates inaccurate mappings for a statement or its tokens. We invite 12 external experts to determine if three commonly used AST mapping algorithms generate accurate mappings for a statement and its tokens for 200 statements. Based on the experts' feedback,we observe that our approach achieves a precision of 0.98 1.00 and a recall of 0.65 0.75. Furthermore, we conduct a large scale study with a dataset of ten Java projects, containing a total of 263,165 file revisions. Our approach determines that GumTree, MTDiff and IJM generate inaccurate mappings for 20 29 , 25 36 and 21 30 of the file revisions, respectively. Our experimental results show that state of art AST mapping agorithms still need improvements.


Multi Objective Recommendations A Tutorial. Recommender systems (RecSys) have been well developed to assist user decision making. Traditional RecSys usually optimize a single objective (e.g., rating prediction errors or ranking quality) in the model. There is an emerging demand in multi objective optimization recently in RecSys, especially in the area of multi stakeholder and multi task recommender systems. This article provides an overview of multi objective recommendations, followed by the discussions with case studies. The document is considered as a supplementary material for our tutorial on multi objective recommendations at ACM SIGKDD 2021.


Cyclic and Quasi Cyclic DNA Codes. In this paper, we discuss DNA codes that are cyclic or quasi cyclic over Z 4 omega Z 4 , where omega 2 2 2 omega along with methods to construct these with combinatorial constraints. We also generalize results obtained for the ring Z 4 omega Z 4 , where omega 2 2 2 omega , and some other rings to the sixteen rings R theta Z 4 omega Z 4 , where omega 2 theta in Z 4 omega Z 4 , using the generalized Gau map and Gau distance in cite 3 . We determine a relationship between the Gau distance and Hamming distance for linear codes over the sixteen rings R theta which enables us to attain an upper boundary for the Gau distance of free codes that are self dual over the rings R theta .


Coagulation dynamics under random field turbulence effects on rain. Turbulence in growth of rain droplets and rain formation is studied under an approximating particle system representing aggregation at the level of individuals, depending on their volume and distance in space, of the Smoluchowski Coagulation equation. A random field is introduced to model the air flow interaction with the particles and it is proved that the empirical density of the individual converges to solutions of limiting equation under different setting for the random field of interaction. A brief numerical study for the continuous density is proposed using the particles approach, to analyze how noise can arise in such system and the effectiveness on rain formation.


Circuit Masking From Theory to Standardization, A Comprehensive Survey for Hardware Security Researchers and Practitioners. Side channel attacks extracting sensitive data from implementations have been considered a major threat to the security of cryptographic schemes. This has elevated the need for improved designs by embodying countermeasures, with masking being the most prominent example. To formally verify the security of a masking scheme, numerous attack models have been developed to capture the physical properties of the information leakage as well as the capabilities of the adversary. With regard to these models, extensive research has been performed to realize masking schemes. These research efforts have led to significant progress in the development of security assessment methodologies and further initiated standardization activities. However, since the majority of this work is theoretical, it is challenging for the more practice oriented hardware security community to fully grasp and contribute to. To bridge the gap, these advancements are reviewed and discussed in this survey, mainly from the perspective of hardware security. In doing so, a clear taxonomy is provided that is helpful for a systematic treatment of the masking related topics. By giving an extensive overview of the existing methods, this survey (1) provides a research landscape of circuit masking for newcomers to the field, (2) offers guidelines on which attack model and verification tool to choose when designing masking schemes, and (3) identifies interesting new research directions where masking models and assessment tools can be applied. Thus, this survey serves as an essential reference for hardware security practitioners interested in the theory behind masking techniques, the tools useful to verify the security of masked circuits, and their potential applications.


General Greedy De bias Learning. Neural networks often make predictions relying on the spurious correlations from the datasets rather than the intrinsic properties of the task of interest, facing sharp degradation on out of distribution (OOD) test data. Existing de bias learning frameworks try to capture specific dataset bias by bias annotations, they fail to handle complicated OOD scenarios. Others implicitly identify the dataset bias by the special design on the low capability biased model or the loss, but they degrade when the training and testing data are from the same distribution. In this paper, we propose a General Greedy De bias learning framework (GGD), which greedily trains the biased models and the base model like gradient descent in functional space. It encourages the base model to focus on examples that are hard to solve with biased models, thus remaining robust against spurious correlations in the test stage. GGD largely improves models' OOD generalization ability on various tasks, but sometimes over estimates the bias level and degrades on the in distribution test. We further re analyze the ensemble process of GGD and introduce the Curriculum Regularization into GGD inspired by curriculum learning, which achieves a good trade off between in distribution and out of distribution performance. Extensive experiments on image classification, adversarial question answering, and visual question answering demonstrate the effectiveness of our method. GGD can learn a more robust base model under the settings of both task specific biased models with prior knowledge and self ensemble biased model without prior knowledge.


Brittle Features May Help Anomaly Detection. One class anomaly detection is challenging. A representation that clearly distinguishes anomalies from normal data is ideal, but arriving at this representation is difficult since only normal data is available at training time. We examine the performance of representations, transferred from auxiliary tasks, for anomaly detection. Our results suggest that the choice of representation is more important than the anomaly detector used with these representations, although knowledge distillation can work better than using the representations directly. In addition, separability between anomalies and normal data is important but not the sole factor for a good representation, as anomaly detection performance is also correlated with more adversarially brittle features in the representation space. Finally, we show our configuration can detect 96.4 of anomalies in a genuine X ray security dataset, outperforming previous results.


Energy stability of the Charney DeVore quasi geostrophic equation for atmospheric blocking. Charney and DeVore J. Atmos. Sci. 36 (1979), 1205 1216 found multiple equilibrium states as a consequence of bottom topography in their pioneering work on the quasi geostrophic barotropic flow over topography in a beta plane channel. In the present paper, we prove that the basic flow is asymptotically stable in a parameter region, including the flat topography situation, which excludes the existence of multiple equilibrium states therein. Moreover, we show that an additional condition on the average zonal force or the average zonal velocity is indispensable to the well posedness of the Charney DeVore quasi geostrophic equation. Coexistence of at least three equilibrium states is confirmed by a pseudo arclength continuation method for different topographic amplitudes. The stabilities of the equilibrium states are examined by high resolution direct numerical simulations.


Cohort Characteristics and Factors Associated with Cannabis Use among Adolescents in Canada Using Pattern Discovery and Disentanglement Method. COMPASS is a longitudinal, prospective cohort study collecting data annually from students attending high school in jurisdictions across Canada. We aimed to discover significant frequent rare associations of behavioral factors among Canadian adolescents related to cannabis use. We use a subset of COMPASS dataset which contains 18,761 records of students in grades 9 to 12 with 31 selected features (attributes) involving various characteristics, from living habits to academic performance. We then used the Pattern Discovery and Disentanglement (PDD) algorithm that we have developed to detect strong and rare (yet statistically significant) associations from the dataset. PDD used the criteria derived from disentangled statistical spaces (known as Re projected Adjusted Standardized Residual Vector Spaces, notated as RARV). It outperformed methods using other criteria (i.e. support and confidence) popular as reported in the literature. Association results showed that PDD can discover i) a smaller set of succinct significant associations in clusters ii) frequent and rare, yet significant, patterns supported by population health relevant study iii) patterns from a dataset with extremely imbalanced groups (majority class minority class 88.3 11.7 ).


Stable sets of contracts in two sided markets. We revisit the problem of existence of stable systems of contracts with arbitrary sets of contracts. We show that stable sets of contracts exists if choices of agents satisfy path independence. We call such choice functions Plott functions. Our proof is based on application of Zorn lemma to a special poset of semi stable pairs. Moreover, we construct a dynamic process on the poset (generalizing algorithm Gale and Shapley) steady states of which are stable sets. In Appendix we discuss Lehmann hyper orders and establish a bijection between the set of Lehmann hyper orders and the set of Plott functions.


C 1 actions on the circle of finite index subgroups of Mod( Sigma g) , Aut(F n) , and Out(F n) . Let Sigma g be a closed, connected, and oriented surface of genus g geq 24 and let Gamma be a finite index subgroup of the mapping class group Mod( Sigma g ) that contains the Torelli group mathcal I ( Sigma g) . Then any orientation preserving C 1 action of Gamma on the circle cannot be faithful. We also show that if Gamma is a finite index subgroup of Aut(F n) , when n geq 8 , that contains the subgroup of IA automorphisms, then any orientation preserving C 1 action of Gamma on the circle cannot be faithful. Similarly, if Gamma is a finite index subgroup of Out(F n) , when n geq 8 , that contains the Torelli group mathcal T n , then any orientation preserving C 1 action of Gamma on the circle cannot be faithful. In fact, when n geq 10 , any orientation preserving C 1 action of a finite index subgroup of Aut(F n) or Out(F n) on the circle cannot be faithful.


Developer Operations and Engineering Multi Agent Systems. In this paper, we propose the integration of approaches to Engineering Multi Agent Systems (EMAS) with the Developer Operations (DevOps) industry best practice. Whilst DevOps facilitates the organizational autonomy of software teams, as well as the technological automation of testing, deployment, and operations pipelines, EMAS and the agent oriented programming paradigm help instill autonomy into software artifacts. We discuss the benefits of integrating DevOps and EMAS, for example by highlighting the need for agent oriented abstractions for quality assurance and test automation approaches. More generally, we introduce an agent oriented perspective on the DevOps life cycle and list a range of research challenges that are relevant for the integration of the DevOps and EMAS perspectives.


On second order q difference equations for high order Sobolev type q Hermite orthogonal polynomials. The q Hermite I Sobolev type polynomials of higher order are consider for their study. Their hypergeometric representation is provided together with further useful properties such as several structure relations which give rise to a three term recurrence relation of their elements. Two different q difference equations satisfied by the q Hermite I Sobolev type polynomials of higher order are also established.


Edge Prior Augmented Networks for Motion Deblurring on Naturally Blurry Images. Motion deblurring has witnessed rapid development in recent years, and most of the recent methods address it by using deep learning techniques, with the help of different kinds of prior knowledge. Concerning that deblurring is essentially expected to improve the image sharpness, edge information can serve as an important prior. However, the edge has not yet been seriously taken into consideration in previous methods when designing deep models. To this end, we present a novel framework that incorporates edge prior knowledge into deep models, termed Edge Prior Augmented Networks (EPAN). EPAN has a content based main branch and an edge based auxiliary branch, which are constructed as a Content Deblurring Net (CDN) and an Edge Enhancement Net (EEN), respectively. EEN is designed to augment CDN in the deblurring process via an attentive fusion mechanism, where edge features are mapped as spatial masks to guide content features in a feature based hierarchical manner. An edge guided loss function is proposed to further regulate the optimization of EPAN by enforcing the focus on edge areas. Besides, we design a dual camera based image capturing setting to build a new dataset, Real Object Motion Blur (ROMB), with paired sharp and naturally blurry images of fast moving cars, so as to better train motion deblurring models and benchmark the capability of motion deblurring algorithms in practice. Extensive experiments on the proposed ROMB and other existing datasets demonstrate that EPAN outperforms state of the art approaches qualitatively and quantitatively.


On the 2 packing differential of a graph. Let G be a graph of order n(G) and vertex set V(G) . Given a set S subseteq V(G) , we define the external neighbourhood of S as the set N e(S) of all vertices in V(G) setminus S having at least one neighbour in S . The differential of S is defined to be partial(S) N e(S) S . In this paper, we introduce the study of the 2 packing differential of a graph, which we define as partial 2p (G) max partial(S) S subseteq V(G) text is a 2 text packing . We show that the 2 packing differential is closely related to several graph parameters, including the packing number, the independent domination number, the total domination number, the perfect differential, and the unique response Roman domination number. In particular, we show that the theory of 2 packing differentials is an appropriate framework to investigate the unique response Roman domination number of a graph without the use of functions. Among other results, we obtain a Gallai type theorem, which states that partial 2p (G) mu R (G) n(G) , where mu R (G) denotes the unique response Roman domination number of G . As a consequence of the study, we derive several combinatorial results on mu R (G) , and we show that the problem of finding this parameter is NP hard. In addition, the particular case of lexicographic product graphs is discussed.


Infinite families of crank functions, Stanton type conjectures, and unimodality. Dyson's rank function and the Andrews Garvan crank function famously give combinatorial witnesses for Ramanujan's partition function congruences modulo 5, 7, and 11. While these functions can be used to show that the corresponding sets of partitions split into 5, 7, or 11 equally sized sets, one may ask how to make the resulting bijections between partitions organized by rank or crank combinatorially explicit. Stanton recently made conjectures which aim to uncover a deeper combinatorial structure along these lines, where it turns out that minor modifications of the rank and crank are required. Here, we prove two of these conjectures. We also provide abstract criteria for quotients of polynomials by certain cyclotomic polynomials to have non negative coefficients based on unimodality and symmetry. Furthermore, we extend Stanton's conjecture to an infinite family of cranks. This suggests further applications to other combinatorial objects. We also discuss numerical evidence for our conjectures, connections with other analytic conjectures such as the distribution of partition ranks.


Passage Retrieval for Outside Knowledge Visual Question Answering. In this work, we address multi modal information needs that contain text questions and images by focusing on passage retrieval for outside knowledge visual question answering. This task requires access to outside knowledge, which in our case we define to be a large unstructured passage collection. We first conduct sparse retrieval with BM25 and study expanding the question with object names and image captions. We verify that visual clues play an important role and captions tend to be more informative than object names in sparse retrieval. We then construct a dual encoder dense retriever, with the query encoder being LXMERT, a multi modal pre trained transformer. We further show that dense retrieval significantly outperforms sparse retrieval that uses object expansion. Moreover, dense retrieval matches the performance of sparse retrieval that leverages human generated captions.


NeuSE A Neural Snapshot Ensemble Method for Collaborative Filtering. In collaborative filtering (CF) algorithms, the optimal models are usually learned by globally minimizing the empirical risks averaged over all the observed data. However, the global models are often obtained via a performance tradeoff among users items, i.e., not all users items are perfectly fitted by the global models due to the hard non convex optimization problems in CF algorithms. Ensemble learning can address this issue by learning multiple diverse models but usually suffer from efficiency issue on large datasets or complex algorithms. In this paper, we keep the intermediate models obtained during global model learning as the snapshot models, and then adaptively combine the snapshot models for individual user item pairs using a memory network based method. Empirical studies on three real world datasets show that the proposed method can extensively and significantly improve the accuracy (up to 15.9 relatively) when applied to a variety of existing collaborative filtering methods.


An introduction to Hilbert schemes of points on ADE singularities. This paper is based on a talk at the conference The McKay correspondence, mutation and related topics' from July 2020. We provide an introduction to joint work of the author with S o ren Gammelgaard, ' A d ' a m Gyenge and Bal ' a zs Szendr H o i that constructs the reduced scheme underlying the Hilbert scheme of n points on an ADE singularity as a Nakajima quiver variety for a particular stability parameter. After drawing a parallel with two well known constructions of the Hilbert scheme of n points in mathbb A 2 , we summarise results of the author and Gwyn Bellamy before describing the main result by cornering a noncommutative algebra obtained from the preprojective algebra of the framed McKay graph.


Moduli spaces of nonnegatively curved metrics on exotic spheres. We show that the moduli space of nonnegatively curved metrics on a manifold homeomorphic to S 7 has infinitely many path components. The components are distinguished using the Kreck Stolz s invariant computed for metrics constructed by Goette, Kerin and Shankar. The invariant is computed by extending each metric to the total space of an orbifold disc bundle and applying generalizations of the Atiyah Patodi Singer index theorem for orbifolds with boundary.


Magnetic Measurements of HL LHC AUP Cryo Assemblies at Fermilab. LQXFA B production series cryogenic assemblies are being built for the LHC upgrade by the HL LHC Accelerator Upgrade Project (AUP). These contain a pair of MQXFA quadrupole magnets combined as a cold mass within a vacuum vessel, and are to be installed in the IR regions of the LHC. The LQXFA B are being tested at 1.9 K to assess alignment and magnetic performance at Fermilab's horizontal test facility. The 10 m long assembly must meet stringent specifications for quadrupole strength and harmonic field integrals determination, magnetic axis location, and for variations in axis position and local field profile. A multi probe, PCB based rotating coil and Single Stretched Wire system are employed for these measurements. To accurately determine rotating coil location and angles within the cold mass, a laser tracker is utilized to record multiple targets at one end of the probe. This paper describes the measurements, probes equipment, and techniques used to perform the necessary characterization of the cold mass.


Data driven method to learn the most probable transition pathway and stochastic differential equations. Transition phenomena between metastable states play an important role in complex systems due to noisy fluctuations. In this paper, the physics informed neural networks (PINNs) are presented to compute the most probable transition pathway. It is shown that the expected loss is bounded by the empirical loss. And the convergence result for the empirical loss is obtained. Then, a sampling method of rare events is presented to simulate the transition path by the Markovian bridge process. And we investigate the inverse problem to extract the stochastic differential equation from the most probable transition pathway data and the Markovian bridge process data, respectively. Finally, several numerical experiments are presented to verify the effectiveness of our methods.


Euler's factorial series, Hardy integral, and continued fractions. We study p adic Euler's series E p(t) sum k 0 infty k!t k at a point p a , a in mathbb Z ge 1 , and use Pad 'e approximations to prove a lower bound for the p adic absolute value of the expression dE p left(p a right) c , where c, d in mathbb Z . It is interesting that the same Pad 'e polynomials which p adically converge to E p(t) , approach the Hardy integral mathcal H (t) int 0 infty frac e s 1 ts mathrm d s on the Archimedean side. This connection is used with a trick of analytic continuation when deducing an Archimedean bound for the numerator Pad 'e polynomial needed in the derivation of the lower bound for dE p left(p a right) c p . Furthermore, we present an interconnection between E(t) and mathcal H (t) via continued fractions.


Optimizing Inference Performance of Transformers on CPUs. The Transformer architecture revolutionized the field of natural language processing (NLP). Transformers based models (e.g., BERT) power many important Web services, such as search, translation, question answering, etc. While enormous research attention is paid to the training of those models, relatively little efforts are made to improve their inference performance. This paper comes to address this gap by presenting an empirical analysis of scalability and performance of inferencing a Transformer based model on CPUs. Focusing on the highly popular BERT model, we identify key components of the Transformer architecture where the bulk of the computation happens, and propose three optimizations to speed them up. The optimizations are evaluated using the inference benchmark from HuggingFace, and are shown to achieve the speedup of up to x2.37. The considered optimizations do not require any changes to the implementation of the models nor affect their accuracy.


A novel high dimensional fitted scheme for stochastic optimal control problems. Stochastic optimal principle leads to the resolution of a partial differential equation (PDE), namely the Hamilton Jacobi Bellman (HJB) equation. In general, this equation cannot be solved analytically, thus numerical algorithms are the only tools to provide accurate approximations. The aims of this paper is to introduce a novel fitted finite volume method to solve high dimensional degenerated HJB equation from stochastic optimal control problems in high dimension ( n geq 3 ). The challenge here is due to the nature of our HJB equation which is a degenerated second order partial differential equation coupled with an optimization problem. For such problems, standard scheme such as finite difference method losses its monotonicity and therefore the convergence toward the viscosity solution may not be guarantee. We discretize the HJB equation using the fitted finite volume method, well known to tackle degenerated PDEs, while the time discretisation is performed using the Implicit Euler scheme. We show that matrices resulting from spatial discretization and temporal discretization are M matrices. Numerical results in finance demonstrating the accuracy of the proposed numerical method comparing to the standard finite difference method are provided.


Total, Equitable Total and Neighborhood sum distinguishing Total Colorings of Some Classes of Circulant Graphs. In this paper, we have obtained the total chromatic as well as equitable and neighborhood sum distinguishing total chromatic numbers of some classes of the circulant graphs.


The role of freshwater forcing on surface predictability in the Gulf of Mexico. The predictability of fields at the ocean surface in the northern Gulf of Mexico (GoM) is investigated through five ensembles of regional ocean simulations between 2014 and 2016. The ensembles explore two horizontal resolutions and different representations of the riverine inflow, and focus on the Loop Current system (LCS) and the Mississippi Atchafalaya River System (MARS) interactions. The predictability of the surface fields is high in the northern GoM if the atmospheric forcing and the flow at Yucatan Channel are known, and the ensembles simulate similar LCS behavior up to 5 months. In terms of LCS MARS interactions, the ensembles confirm that they are strongly modulated by the LC mesoscale variability. The relationship is two ways, with the LCS being influenced by and not only influencing the freshwater plume. Whenever the freshwater flux is strong, the northward extension of the LCS is constrained. The ensemble simulations also indicate that this influence is stronger if the riverine inflow is simulated in an active fashion with a meridional velocity component proportional to the flux. Sea surface temperature (SST) and salinity (SSS) predictability have opposite seasonality in their signal, with the SST (SSS) field being more predictable in summer (winter). Partially resolving submesoscale instabilities and improving the accuracy of the riverine fluxes' representation causes the spread to increase, especially in SST. Finally, the predictability of surface relative vorticity decreases in amplitude when increasing resolution due to feedbacks between the mesoscale and submesoscale circulations, but retains most of its intraseasonal and interannual signal.


Operator valued rational functions. In this paper we show that every inner divisor of the operator valued coordinate function, zI E , is a Blaschke Potapov factor. We also introduce a notion of operator valued "rational" function and then show that Delta is two sided inner and rational if and only if it can be represented as a finite Blaschke Potapov product this extends to operator valued functions the well known result proved by V.P. Potapov for matrix valued functions.


Product Expansions of q Character Polynomials. The ring of q character polynomials is a q analog of the classical ring of character polynomials for the symmetric groups. This ring consists of certain class functions defined simultaneously on the groups Gl n(F q) for all n, which we also interpret as statistics on matrices. Here we evaluate these statistics on all matrices and work towards computing the structure constants of the product in this ring. We show that the statistics are periodically polynomial in q, and governed by universal polynomials P lambda, mu (q) which we compute explicitly, indexed by pairs of integer partitions. The product structure is similarly polynomial in q in many cases, governed by polynomials R lambda, mu nu (q) indexed by triples of partitions, which we compute in some cases. Our calculations seem to exhibit several unexpected patterns. Mainly, we conjecture that certain indecomposable statistics generate the whole ring, and indeed prove this for statistics associated with matrices consisting of up to 2 Jordan blocks. Furthermore, the coefficients we compute exhibit surprising stability phenomena, which in turn reflect stabilizations of joint moments as well as multiplicities in the irreducible decomposition of tensor products of representations of Gl n(F q) for n gg 1 . We use this stabilization to compute the correlation of the number of unipotent Jordan blocks of two sizes.


A note on tridiagonal matrices with zero main diagonal. We find the spectrum of an arbitrary irreducible complex tridiagonal matrix with two periodic main diagonal provided that the spectrum of the matrix with the same sub and superdiagonals and zero main diagonal is known. Our result substantially generalises some of the recent results on the Sylvester Kac matrix and its certain main principal submatrix.


Dosimetric impact of physician style variations in contouring CTV for post operative prostate cancer A deep learning based simulation study. Inter observer variation is a significant problem in clinical target volume(CTV) segmentation in postoperative settings, where there is no gross tumor present. In this scenario, the CTV is not an anatomically established structure, but one determined by the physician based on the clinical guideline used, the preferred tradeoff between tumor control and toxicity, their experience and training background, and other factors. This results in high inter observer variability between physicians. This variability has been considered an issue, but the absence of multiple physician CTV contours for each patient and the significant amount of time required for dose planning have made it impractical to study its dosimetric consequences. In this study, we analyze the impact that variations in physician style have on dose to organs at risk(OAR) by simulating the clinical workflow via deep learning. For a given patient previously treated by one physician, we use deep learning based tools to simulate how other physicians would contour the CTV and how the corresponding dose distributions would look for this patient. To simulate multiple physician styles, we use a previously developed in house CTV segmentation model that can produce physician style aware segmentations. The corresponding dose distribution is predicted using another in house deep learning tool, which, can predict dose within 3 of the prescription dose, on average, on the test data. For every test patient, four different physician style CTVs are considered, and four different dose distributions are analyzed. OAR dose metrics are compared, showing that even though physician style variations result in organs getting different doses, all the important dose metrics except Maximum Dose point are within the clinically acceptable limit.


Fourier growth of structured mathbb F 2 polynomials and applications. We analyze the Fourier growth, i.e. the L 1 Fourier weight at level k (denoted L 1,k ), of various well studied classes of "structured" mathbb F 2 polynomials. This study is motivated by applications in pseudorandomness, in particular recent results and conjectures due to CHHL19,CHLT19,CGLSS20 which show that upper bounds on Fourier growth (even at level k 2 ) give unconditional pseudorandom generators. Our main structural results on Fourier growth are as follows We show that any symmetric degree d mathbb F 2 polynomial p has L 1,k (p) le Pr p 1 cdot O(d) k , and this is tight for any constant k . This quadratically strengthens an earlier bound that was implicit in RSV13 . We show that any read Delta degree d mathbb F 2 polynomial p has L 1,k (p) le Pr p 1 cdot (k Delta d) O(k) . We establish a composition theorem which gives L 1,k bounds on disjoint compositions of functions that are closed under restrictions and admit L 1,k bounds. Finally, we apply the above structural results to obtain new unconditional pseudorandom generators and new correlation bounds for various classes of mathbb F 2 polynomials.


ToxCCIn Toxic Content Classification with Interpretability. Despite the recent successes of transformer based models in terms of effectiveness on a variety of tasks, their decisions often remain opaque to humans. Explanations are particularly important for tasks like offensive language or toxicity detection on social media because a manual appeal process is often in place to dispute automatically flagged content. In this work, we propose a technique to improve the interpretability of these models, based on a simple and powerful assumption a post is at least as toxic as its most toxic span. We incorporate this assumption into transformer models by scoring a post based on the maximum toxicity of its spans and augmenting the training process to identify correct spans. We find this approach effective and can produce explanations that exceed the quality of those provided by Logistic Regression analysis (often regarded as a highly interpretable model), according to a human study.


Eliciting Thinking Hierarchy without Prior. A key challenge in crowdsourcing is that majority may make systematic mistakes (e.g. in the classic bat and ball problem A bat and ball cost 1.10. The bat costs 1 more than the ball. How much does the ball cost?, the majority may answer .10). Prior work focuses on eliciting the best answer without prior even when the majority is wrong. Here we focus on eliciting the full thinking hierarchy without any prior. By asking a single open response question and eliciting both of each respondent's answer (e.g. .05) and guess(es) for other people's answers (e.g. .10), we construct an answer guess matrix that records the number of people who report a specific answer guess pair (e.g. 10 people answer .05 and guess .10). By ranking the answers to maximize the sum of the upper triangular area of the matrix, we obtain and visualize the hierarchy of the answers without any prior (e.g. we obtain " .05 .5 .10" hierarchy for bat and ball in our study). Our paradigm is highly practical since unlike prior work, the respondent does not need to perform multiple tasks nor report a distribution. Moreover, the requester does not need prior knowledge to design possible options for respondents. Our empirical studies not only demonstrate the superiority of our approach compared to plurality vote, but also show that more sophisticated people can reason about less sophisticated people's mind and the hierarchy can be approximately described by a directed acyclic graph.


Genre determining prediction Non standard TAM marking in football language. German and French football language display tense aspect mood (TAM) forms which differ from the TAM use in other genres. In German football talk, the present indicative may replace the pluperfect subjunctive. In French reports of football matches, the imperfective past may occur instead of a perfective past tense aspect form. We argue that the two phenomena share a functional core and are licensed in the same way, which is a direct result of the genre they occur in. More precisely, football match reports adhere to a precise script and specific events are temporally determined in terms of objective time. This allows speakers to exploit a secondary function of TAM forms, namely, they shift the temporal perspective. We argue that it is on the grounds of the genre that comprehenders predict the deviating forms and are also able to decode them. We present various corpus studies where we explore the functioning of these phenomena in order to gain insights into their distribution, grammaticalization and their functioning in discourse. Relevant factors are Aktionsart properties, rhetorical relations and their interaction with other TAM forms. This allows us to discuss coping mechanisms on the part of the comprehender. We broaden our understanding of the phenomena, which have only been partly covered for French and up to now seem to have been ignored in German.


Continuous Non Invasive Eye Tracking In Intensive Care. Delirium, an acute confusional state, is a common occurrence in Intensive Care Units (ICUs). Patients who develop delirium have globally worse outcomes than those who do not and thus the diagnosis of delirium is of importance. Current diagnostic methods have several limitations leading to the suggestion of eye tracking for its diagnosis through in attention. To ascertain the requirements for an eye tracking system in an adult ICU, measurements were carried out at Chelsea Westminster Hospital NHS Foundation Trust. Clinical criteria guided empirical requirements of invasiveness and calibration methods while accuracy and precision were measured. A non invasive system was then developed utilising a patient facing RGB camera and a scene facing RGBD camera. The system's performance was measured in a replicated laboratory environment with healthy volunteers revealing an accuracy and precision that outperforms what is required while simultaneously being non invasive and calibration free The system was then deployed as part CONfuSED, a clinical feasibility study where we report aggregated data from 5 patients as well as the acceptability of the system to bedside nursing staff. The system is the first eye tracking system to be deployed in an ICU.


Online Product Feature Recommendations with Interpretable Machine Learning. Product feature recommendations are critical for online customers to purchase the right products based on the right features. For a customer, selecting the product that has the best trade off between price and functionality is a time consuming step in an online shopping experience, and customers can be overwhelmed by the available choices. However, determining the set of product features that most differentiate a particular product is still an open question in online recommender systems. In this paper, we focus on using interpretable machine learning methods to tackle this problem. First, we identify this unique product feature recommendation problem from a business perspective on a major US e commerce site. Second, we formulate the problem into a price driven supervised learning problem to discover the product features that could best explain the price of a product in a given product category. We build machine learning models with a model agnostic method Shapley Values to understand the importance of each feature, rank and recommend the most essential features. Third, we leverage human experts to evaluate its relevancy. The results show that our method is superior to a strong baseline method based on customer behavior and significantly boosts the coverage by 45 . Finally, our proposed method shows comparable conversion rate against the baseline in online A B tests.


Data Oriented Language Implementation of Lattice Boltzmann Method for Dense and Sparse Geometries. The performance of lattice Boltzmann solver implementations usually depends mainly on memory access patterns. Achieving high performance requires then complex code which handles careful data placement and ordering of memory transactions. In this work, we analyse the performance of an implementation based on a new approach called the data oriented language, which allows the combining of complex memory access patterns with simple source code. As a use case, we present and provide the source code of a solver for D2Q9 lattice and show its performance on GTX Titan Xp GPU for dense and sparse geometries up to 4096 2 nodes. The obtained results are promising, around 1000 lines of code allowed us to achieve performance in the range of 0.6 to 0.7 of maximum theoretical memory bandwidth (over 2.5 and 5.0 GLUPS for double and single precision, respectively) for meshes of size above 1024 2 nodes, which is close to the current state of the art. However, we also observed relatively high and sometimes difficult to predict overheads, especially for sparse data structures. The additional issue was also a rather long compilation, which extended the time of short simulations, and a lack of access to low level optimisation mechanisms.


Uniform block diagonal preconditioners for divergence conforming HDG Methods for the generalized Stokes equations and the linear elasticity equations. We propose a uniform block diagonal preconditioner for condensed H (div) conforming HDG schemes for parameter dependent saddle point problems, including the generalized Stokes equations and the linear elasticity equations. An optimal preconditioner is obtained for the stiffness matrix on the global velocity displacement space via the auxiliary space preconditioning (ASP) technique cite Xu96 . A spectrally equivalent approximation to the Schur complement on the element wise constant pressure space is also constructed, and an explicit computable exact inverse is obtained via the Woodbury matrix identity. Finally, the numerical results verify the robustness of our proposed preconditioner with respect to model parameters and mesh size.


Bellamy Reusing Performance Models for Distributed Dataflow Jobs Across Contexts. Distributed dataflow systems enable the use of clusters for scalable data analytics. However, selecting appropriate cluster resources for a processing job is often not straightforward. Performance models trained on historical executions of a concrete job are helpful in such situations, yet they are usually bound to a specific job execution context (e.g. node type, software versions, job parameters) due to the few considered input parameters. Even in case of slight context changes, such supportive models need to be retrained and cannot benefit from historical execution data from related contexts. This paper presents Bellamy, a novel modeling approach that combines scale outs, dataset sizes, and runtimes with additional descriptive properties of a dataflow job. It is thereby able to capture the context of a job execution. Moreover, Bellamy is realizing a two step modeling approach. First, a general model is trained on all the available data for a specific scalable analytics algorithm, hereby incorporating data from different contexts. Subsequently, the general model is optimized for the specific situation at hand, based on the available data for the concrete context. We evaluate our approach on two publicly available datasets consisting of execution data from various dataflow jobs carried out in different environments, showing that Bellamy outperforms state of the art methods.


The brain is a computer is a brain neuroscience's internal debate and the social significance of the Computational Metaphor. The Computational Metaphor, comparing the brain to the computer and vice versa, is the most prominent metaphor in neuroscience and artificial intelligence (AI). Its appropriateness is highly debated in both fields, particularly with regards to whether it is useful for the advancement of science and technology. Considerably less attention, however, has been devoted to how the Computational Metaphor is used outside of the lab, and particularly how it may shape society's interactions with AI. As such, recently publicized concerns over AI's role in perpetuating racism, genderism, and ableism suggest that the term "artificial intelligence" is misplaced, and that a new lexicon is needed to describe these computational systems. Thus, there is an essential question about the Computational Metaphor that is rarely asked by neuroscientists whom does it help and whom does it harm? This essay invites the neuroscience community to consider the social implications of the field's most controversial metaphor.


A Comparison of Modern General Purpose Visual SLAM Approaches. Advancing maturity in mobile and legged robotics technologies is changing the landscapes where robots are being deployed and found. This innovation calls for a transformation in simultaneous localization and mapping (SLAM) systems to support this new generation of service and consumer robots. No longer can traditionally robust 2D lidar systems dominate while robots are being deployed in multi story indoor, outdoor unstructured, and urban domains with increasingly inexpensive stereo and RGB D cameras. Visual SLAM (VSLAM) systems have been a topic of study for decades and a small number of openly available implementations have stood out ORB SLAM3, OpenVSLAM and RTABMap. This paper presents a comparison of these 3 modern, feature rich, and uniquely robust VSLAM techniques that have yet to be benchmarked against each other, using several different datasets spanning multiple domains negotiated by service robots. ORB SLAM3 and OpenVSLAM each were not compared against at least one of these datasets previously in literature and we provide insight through this lens. This analysis is motivated to find general purpose, feature complete, and multi domain VSLAM options to support a broad class of robot applications for integration into the new and improved ROS 2 Nav2 System as suitable alternatives to traditional 2D lidar solutions.


Productive Multitasking for Industrial Robots. The application of robotic solutions to small batch production is challenging economical constraints tend to dramatically limit the time for setting up new batches. Organizing robot tasks into modular software components, called skills, and allowing the assignment of multiple concurrent tasks to a single robot is potentially game changing. However, due to cycle time constraints, it may be necessary for a skill to take over without waiting on another to terminate, and the available literature lacks a systematic approach in this case. In the present article, we fill the gap by (a) establishing the specifications of skills that can be sequenced with partial executions, (b) proposing an implementation based on the combination of finite state machines and behavior trees, and (c) demonstrating the benefits of such skills through extensive trials in the environment of ARIAC (Agile Robotics for Industrial Automation Competition).


Bernoulli sums and R 'enyi entropy inequalities. We investigate the R 'enyi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the R 'enyi entropy, for Poisson Bernoulli variables. As applications we prove that a discrete min entropy power'' is super additive on independent variables up to a universal constant, and give new bounds on an entropic generalization of the Littlewood Offord problem that are sharp in the Poisson regime''.


Learning Adversarially Robust Policies in Multi Agent Games. Robust decision making in multiplayer games requires anticipating what reactions a player policy may elicit from other players. This is difficult in games with three or more players when one player fixes a policy, it induces a subgame between the remaining players with many possible equilibria outcomes. Predicting the worst case outcome of a policy is thus an equilibrium selection problem one known to be generally NP Hard. We show that worst case coarse correlated equilibria can be efficiently approximated in smooth games and propose a framework that uses the worst case evaluation scheme to learn robust player policies. We further prove the framework can be extended to handle uncertainty about the bounded rationality of other players. In experiments, our framework learns robust policies in repeated N player matrix games and, when applied to deep multi agent reinforcement learning, can scale to complex spatiotemporal games. For example, it learns robust AI tax policies that improve welfare by up to 15 , even when taxpayers are boundedly rational.


External Memory Networks for Low Shot Learning of Targets in Forward Looking Sonar Imagery. We propose a memory based framework for real time, data efficient target analysis in forward looking sonar (FLS) imagery. Our framework relies on first removing non discriminative details from the imagery using a small scale DenseNet inspired network. Doing so simplifies ensuing analyses and permits generalizing from few labeled examples. We then cascade the filtered imagery into a novel NeuralRAM based convolutional matching network, NRMN, for low shot target recognition. We employ a small scale FlowNet, LFN to align and register FLS imagery across local temporal scales. LFN enables target label consensus voting across images and generally improves target detection and recognition rates. We evaluate our framework using real world FLS imagery with multiple broad target classes that have high intra class variability and rich sub class structure. We show that few shot learning, with anywhere from ten to thirty class specific exemplars, performs similarly to supervised deep networks trained on hundreds of samples per class. Effective zero shot learning is also possible. High performance is realized from the inductive transfer properties of NRMNs when distractor elements are removed.


A Digital Corpus of St. Lawrence Island Yupik. St. Lawrence Island Yupik (ISO 639 3 ess) is an endangered polysynthetic language in the Inuit Yupik language family indigenous to Alaska and Chukotka. This work presents a step by step pipeline for the digitization of written texts, and the first publicly available digital corpus for St. Lawrence Island Yupik, created using that pipeline. This corpus has great potential for future linguistic inquiry and research in NLP. It was also developed for use in Yupik language education and revitalization, with a primary goal of enabling easy access to Yupik texts by educators and by members of the Yupik community. A secondary goal is to support development of language technology such as spell checkers, text completion systems, interactive e books, and language learning apps for use by the Yupik community.


Hilbert Schemes with Two Borel fixed Points in Arbitrary Characteristic. We extend the recent classification of Hilbert schemes with two Borel fixed points to arbitrary characteristic. We accomplish this by synthesizing Reeves' algorithm for generating strongly stable ideals with the basic properties of Borel fixed ideals and our previous work classifying Hilbert schemes with unique Borel fixed points.


Perspective, Survey and Trends Public Driving Datasets and Toolsets for Autonomous Driving Virtual Test. Owing to the merits of early safety and reliability guarantee, autonomous driving virtual testing has recently gains increasing attention compared with closed loop testing in real scenarios. Although the availability and quality of autonomous driving datasets and toolsets are the premise to diagnose the autonomous driving system bottlenecks and improve the system performance, due to the diversity and privacy of the datasets and toolsets, collecting and featuring the perspective and quality of them become not only time consuming but also increasingly challenging. This paper first proposes a Systematic Literature review approach for Autonomous driving tests (SLA), then presents an overview of existing publicly available datasets and toolsets from 2000 to 2020. Quantitative findings with the scenarios concerned, perspectives and trend inferences and suggestions with 35 automated driving test tool sets and 70 test data sets are also presented. To the best of our knowledge, we are the first to perform such recent empirical survey on both the datasets and toolsets using a SLA based survey approach. Our multifaceted analyses and new findings not only reveal insights that we believe are useful for system designers, practitioners and users, but also can promote more researches on a systematic survey analysis in autonomous driving surveys on dataset and toolsets.


Diversity Promoting Human Motion Interpolation via Conditional Variational Auto Encoder. In this paper, we present a deep generative model based method to generate diverse human motion interpolation results. We resort to the Conditional Variational Auto Encoder (CVAE) to learn human motion conditioned on a pair of given start and end motions, by leveraging the Recurrent Neural Network (RNN) structure for both the encoder and the decoder. Additionally, we introduce a regularization loss to further promote sample diversity. Once trained, our method is able to generate multiple plausible coherent motions by repetitively sampling from the learned latent space. Experiments on the publicly available dataset demonstrate the effectiveness of our method, in terms of sample plausibility and diversity.


A Synthesis Based Approach for Thermal to Visible Face Verification. In recent years, visible spectrum face verification systems have been shown to match the performance of experienced forensic examiners. However, such systems are ineffective in low light and nighttime conditions. Thermal face imagery, which captures body heat emissions, effectively augments the visible spectrum, capturing discriminative facial features in scenes with limited illumination. Due to the increased cost and difficulty of obtaining diverse, paired thermal and visible spectrum datasets, not many algorithms and large scale benchmarks for low light recognition are available. This paper presents an algorithm that achieves state of the art performance on both the ARL VTF and TUFTS multi spectral face datasets. Importantly, we study the impact of face alignment, pixel level correspondence, and identity classification with label smoothing for multi spectral face synthesis and verification. We show that our proposed method is widely applicable, robust, and highly effective. In addition, we show that the proposed method significantly outperforms face frontalization methods on profile to frontal verification. Finally, we present MILAB VTF(B), a challenging multi spectral face dataset that is composed of paired thermal and visible videos. To the best of our knowledge, with face data from 400 subjects, this dataset represents the most extensive collection of publicly available indoor and long range outdoor thermal visible face imagery. Lastly, we show that our end to end thermal to visible face verification system provides strong performance on the MILAB VTF(B) dataset.


Multi Voxel Point Neurons Convolution (MVPConv) for Fast and Accurate 3D Deep Learning. We present a new convolutional neural network, called Multi Voxel Point Neurons Convolution (MVPConv), for fast and accurate 3D deep learning. The previous works adopt either individual point based features or local neighboring voxel based features to process 3D model, which limits the performance of models due to the inefficient computation. Moreover, most of the existing 3D deep learning frameworks aim at solving one specific task, and only a few of them can handle a variety of tasks. Integrating both the advantages of the voxel and point based methods, the proposed MVPConv can effectively increase the neighboring collection between point based features and also promote the independence among voxel based features. Simply replacing the corresponding convolution module with MVPConv, we show that MVPConv can fit in different backbones to solve a wide range of 3D tasks. Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MVPConv improves the accuracy of the backbone (PointNet) by up to 36 , and achieves higher accuracy than the voxel based model with up to 34 times speedup. In addition, MVPConv also outperforms the state of the art point based models with up to 8 times speedup. Notably, our MVPConv achieves better accuracy than the newest point voxel based model PVCNN (a model more efficient than PointNet) with lower latency.


State of the Art Image Hashing. Perceptual image hashing methods are often applied in various objectives, such as image retrieval, finding duplicate or near duplicate images, and finding similar images from large scale image content. The main challenge in image hashing techniques is robust feature extraction, which generates the same or similar hashes in images that are visually identical. In this article, we present a short review of the state of the art traditional perceptual hashing and deep learning based perceptual hashing methods, identifying the best approaches.


Computation of Weighted Bergman Inner Products on Bounded Symmetric Domains and Restriction to Subgroups. Let (G,G 1) be a symmetric pair of holomorphic type, and we consider a pair of Hermitian symmetric spaces D 1 G 1 K 1 subset D G K , realized as bounded symmetric domains in complex vector spaces mathfrak p 1 subset mathfrak p respectively. Then the universal covering group widetilde G of G acts unitarily on the weighted Bergman space mathcal H lambda(D) subset mathcal O (D) on D . Its restriction to the subgroup widetilde G 1 decomposes discretely and multiplicity freely, and its branching law is given explicitly by Hua Kostant Schmid Kobayashi's formula in terms of the K 1 decomposition of the space mathcal P ( mathfrak p 2) of polynomials on the orthogonal complement mathfrak p 2 of mathfrak p 1 in mathfrak p . The object of this article is to compute explicitly the inner product big langle f(x 2), rm e (x overline z ) mathfrak p big rangle lambda for f(x 2) in mathcal P ( mathfrak p 2) , x (x 1,x 2) , z in mathfrak p mathfrak p 1 oplus mathfrak p 2 . For example, when mathfrak p , mathfrak p 2 are of tube type and f(x 2) det(x 2) k , we compute this inner product explicitly by introducing a multivariate generalization of Gauss' hypergeometric polynomials 2F 1 . Also, as an application, we construct explicitly widetilde G 1 intertwining operators (symmetry breaking operators) mathcal H lambda(D) widetilde G 1 to mathcal H mu(D 1) from holomorphic discrete series representations of widetilde G to those of widetilde G 1 , which are unique up to constant multiple for sufficiently large lambda .


Latent Space Explanation by Intervention. The success of deep neural nets heavily relies on their ability to encode complex relations between their input and their output. While this property serves to fit the training data well, it also obscures the mechanism that drives prediction. This study aims to reveal hidden concepts by employing an intervention mechanism that shifts the predicted class based on discrete variational autoencoders. An explanatory model then visualizes the encoded information from any hidden layer and its corresponding intervened representation. By the assessment of differences between the original representation and the intervened representation, one can determine the concepts that can alter the class, hence providing interpretability. We demonstrate the effectiveness of our approach on CelebA, where we show various visualizations for bias in the data and suggest different interventions to reveal and change bias.


The Operator Norm on Weighted Discrete Semigroup Algebras ell 1(S, omega) . Let omega be a weight on a right cancellative semigroup S . Let cdot omega be the weighted norm on the weighted discrete semigroup algebra ell 1(S, omega) . In this paper, we prove that the weight omega satisfies F property if and only if the operator norm cdot omega op of cdot omega is exactly equal to another weighted norm cdot widetilde omega 1 Theorem 2.5 ( iii ) . Though its proof is elementary, the result is unexpectedly surprising. In particular, cdot 1 op is same as cdot 1 on ell 1(S) . Moreover, various examples are discussed to understand the relating among cdot omega op , cdot omega , and ell 1(S, omega) .


Untargeted Effects in Organic Exciton Polariton Transient Spectroscopy A Cautionary Tale. Strong light matter coupling to form exciton and vibropolaritons is increasingly touted as a powerful tool to alter the fundamental properties of organic materials. It is proposed that these states and their facile tunability can be used to rewrite molecular potential energy landscapes and redirect photophysical pathways, with applications from catalysis to electronic devices. Crucial to their photophysical properties is the exchange of energy between coherent, bright polaritons and incoherent dark states. One of the most potent tools to explore this interplay is transient absorption reflectance spectroscopy. Previous studies have revealed unexpectedly long lifetimes of the coherent polariton states, for which there is no theoretical explanation. Applying these transient methods to a series of strong coupled organic microcavities, we recover similar long lived spectral effects. Based on transfer matrix modelling of the transient experiment, we find that virtually the entire photoresponse results from photoexcitation effects other than the generation of polariton states. Our results suggest that the complex optical properties of polaritonic systems make them especially prone to misleading optical signatures, and that more challenging high time resolution measurements on high quality microcavities are necessary to uniquely distinguish the coherent polariton dynamics.


Connection between the Riemann integrability of a multi valued function and of its convex hull. For a Banach space X we demonstrate the equivalence of the following two properties (1) X is B convex (that is, possesses a nontrivial infratype), and (2) if F 0,1 to 2 X setminus varnothing is a multifunction , mathrm conv F denotes the mapping t mapsto mathrm conv F(t) , then the Riemann integrability of mathrm conv F is equivalent to the Riemann integrability of F . For multifunctions with compact values the Riemann integrability of mathrm conv F is equivalent to the Riemann integrability of F without any restrictions on the Banach space X .


Online Edge Coloring via Tree Recurrences and Correlation Decay. We give an online algorithm that with high probability computes a left( frac e e 1 o(1) right) Delta edge coloring on a graph G with maximum degree Delta omega( log n) under online edge arrivals against oblivious adversaries, making first progress on the conjecture of Bar Noy, Motwani, and Naor in this general setting. Our algorithm is based on reducing to a matching problem on locally treelike graphs, and then applying a tree recurrences based approach for arguing correlation decay.


Oscillatory Residual Stresses in Steady Angular Channel Extrusion. Angular channel extrusion has evolved as processes that can induce significant strengthening of the formed product through grain refinement. However, significant residual stresses are developed in the extruded product whose quantification is necessary for accurate process design and subsequent heat treatment. Experimental evaluation of residual stress provides the through thickness (normal) variation at chosen sampling points on the formed product and may provide inaccurate estimates if variations along the extrusion (longitudinal) directions are present. Process models can complement the experimental measurements and improve the estimates of residual stress distribution. While models of this process have been developed, very few of them have been applied to understand the variation of residual stress in the formed products. The present work aims to address this limitation by providing a complete map of residual stress distribution in angular extrusion process through numerical simulations. Interestingly, our simulations show that the angular channel extruded product can have significant longitudinal variation of residual stress depending on the extrusion ratio and strain hardening rate. Detailed analyses of the process reveals that these spatial oscillations occur due to cyclic movement of the contact location between the die and the top billet surface in the exit channel. The outcome of this study suggests that accurate measurement technique of residual stress field in angular channel extruded products should consider the possibility of longitudinal variations. The findings can be extended to other continuous forming processes as well.


Improved efficiency of multilevel Monte Carlo for stochastic PDE through strong pairwise coupling. Multilevel Monte Carlo (MLMC) has become an important methodology in applied mathematics for reducing the computational cost of weak approximations. For many problems, it is well known that strong pairwise coupling of numerical solutions in the multilevel hierarchy is needed to obtain efficiency gains. In this work, we show that strong pairwise coupling indeed is also important when (MLMC) is applied to stochastic partial differential equations (SPDE) of reaction diffusion type, as it can improve the rate of convergence and thus improve tractability. For the (MLMC) method with strong pairwise coupling that was developed and studied numerically on filtering problems in it Chernov et al., Numer. Math., 147 (2021), 71 125 , we prove that the rate of computational efficiency is higher than for existing methods. We also provide numerical comparisons with alternative coupling ideas illustrate the importance of this feature. The comparisons are conducted on a range of SPDE, which include a linear SPDE, a stochastic reaction diffusion equation, and stochastic Allen Cahn equation.


ReIGNN State Register Identification Using Graph Neural Networks for Circuit Reverse Engineering. Reverse engineering an integrated circuit netlist is a powerful tool to help detect malicious logic and counteract design piracy. A critical challenge in this domain is the correct classification of data path and control logic registers in a design. We present ReIGNN, a novel learning based register classification methodology that combines graph neural networks (GNNs) with structural analysis to classify the registers in a circuit with high accuracy and generalize well across different designs. GNNs are particularly effective in processing circuit netlists in terms of graphs and leveraging properties of the nodes and their neighborhoods to learn to efficiently discriminate between different types of nodes. Structural analysis can further rectify any registers misclassified as state registers by the GNN by analyzing strongly connected components in the netlist graph. Numerical results on a set of benchmarks show that ReIGNN can achieve, on average, 96.5 balanced accuracy and 97.7 sensitivity across different designs.