Distributed NLI Learning to Predict Human Opinion Distributions for Language Reasoning. We introduce distributed NLI, a new NLU task with a goal to predict the distribution of human judgements for natural language inference. We show that by applying additional distribution estimation methods, namely, Monte Carlo (MC) Dropout, Deep Ensemble, Re Calibration, and Distribution Distillation, models can capture human judgement distribution more effectively than the softmax baseline. We show that MC Dropout is able to achieve decent performance without any distribution annotations while Re Calibration can give further improvements with extra distribution annotations, suggesting the value of multiple annotations for one example in modeling the distribution of human judgements. Despite these improvements, the best results are still far below the estimated human upper bound, indicating that predicting the distribution of human judgements is still an open, challenging problem with a large room for improvements. We showcase the common errors for MC Dropout and Re Calibration. Finally, we give guidelines on the usage of these methods with different levels of data availability and encourage future work on modeling the human opinion distribution for language reasoning. Our code and data are publicly available at https github.com easonnie ChaosNLI


Einstein hypersurfaces of Damek Ricci spaces. Einstein hypersurfaces are very rare" in rank one symmetric spaces. Damek Ricci spaces may be viewed as the closest and the most natural generalisations of noncompact rank one symmetric spaces. We prove that no Damek Ricci space admits an Einstein hypersurface.


The Role of Euclid's Circle of Ideas. In this small note I try to summarize some observations about Euclid's remarkable role in mathematics and about the ambient philosophy.


Experimental review of distance sensors for indoor mapping. In this paper, some of the distance sensor, including Kinect, Hokuyo UTM 30LX, and RPLidar were observed experimentally. Strengths and weaknesses of each sensor were reviewed so that it can be used as a reference for selecting a suitable sensor for any particular application. A software application has been developed in C programming language as a platform for gathering information for all tested sensors. According to the experiment results, it showed that Hokuyo UTM 30LX results in random normally distributed error on measuring distance with average error 21.94 mm and variance 32.11. On the other hand, error measurement resulted by Kinect and RPLidar strongly depended on measured distance of the object from the sensors, while measurement error resulted by Kinect had a negative correlation with the measured distance and the error resulted by RPLidar sensor had a positive correlation with the measured distance. The performance of these three sensors for detecting a transparent object shows that the Kinect sensors can detect the transparent object on its effective range measurement, Hokuyo UTM 30LX can detect the transparent object in the distance more than equal to 200 mm, and the RPLidar sensor cannot detect the transparent object at all tested distance. Lastly, the experiment shows that the Hokuyo UTM 30LX has the fastest processing time significantly, and the RPLidar has the slowest processing time significantly, while the processing time of Kinect sensor was in between. These processing times were not significantly affected by various tested distance measurement.


Fast deterministic approximation of symmetric indefinite kernel matrices with high dimensional datasets. Kernel methods are used frequently in various applications of machine learning. For large scale high dimensional applications, the success of kernel methods hinges on the ability to operate certain large dense kernel matrix K. An enormous amount of literature has been devoted to the study of symmetric positive semi definite (SPSD) kernels, where Nystrom methods compute a low rank approximation to the kernel matrix via choosing landmark points. In this paper, we study the Nystrom method for approximating both symmetric indefinite kernel matrices as well SPSD ones. We first develop a theoretical framework for general symmetric kernel matrices, which provides a theoretical guidance for the selection of landmark points. We then leverage discrepancy theory to propose the anchor net method for computing accurate Nystrom approximations with optimal complexity. The anchor net method operates entirely on the dataset without requiring the access to K or its matrix vector product. Results on various types of kernels (both indefinite and SPSD ones) and machine learning datasets demonstrate that the new method achieves better accuracy and stability with lower computational cost compared to the state of the art Nystrom methods.


Understanding the relationship between visual angle and eye angle for reliable determination of the field of view in ultra wide field fundus photography. Abstract Visual angle has been used as the conventional unit to determine the field of view (FOV) in traditional fundus photography. Recently emerging usage of eye angle as the unit in wide field fundus photography creates confusions about FOV interpretation in instrumentation design and clinical application. This study is to systematically derive the relationship between the visual angle theta v and eye angle theta e, and thus to enable reliable determination of the FOV in wide field fundus photography. FOV conversion ratio theta e theta v, angular conversion ratio Delta theta e Delta theta v, retinal conversion ratio Delta d Delta theta v, retinal distance and area are quantitatively evaluated. Systematical analysis indicates that reliable conversion between the theta v and theta e requires determined nodal point and spherical radius of the eye and the conversion ratio is not linear from the central field to peripheral region. Based on the eye model with average parameters, both angular conversion ( Delta theta e Delta theta v) and retinal conversion ( Delta d Delta theta v) ratios are observed to have a 1.51 fold difference at the central field and far peripheral region. A conversion table, including theta e theta v, Delta theta e Delta theta v, Delta d Delta theta v, retinal area and percentage ratio, is created for reliable assessment of imaging systems with variable FOV.


Increasing Adversarial Uncertainty to Scale Private Similarity Testing. Social media and other platforms rely on automated detection of abusive content to help combat disinformation, harassment, and abuse. One common approach is to check user content for similarity against a server side database of problematic items. However, this method fundamentally endangers user privacy. Instead, we target client side detection, notifying only the users when such matches occur to warn them against abusive content. Our solution is based on privacy preserving similarity testing. Existing approaches rely on expensive cryptographic protocols that do not scale well to large databases and may sacrifice the correctness of the matching. To contend with this challenge, we propose and formalize the concept of similarity based bucketization (SBB). With SBB, a client reveals a small amount of information to a database holding server so that it can generate a bucket of potentially similar items. The bucket is small enough for efficient application of privacy preserving protocols for similarity. To analyze the privacy risk of the revealed information, we introduce a framework for measuring an adversary's confidence in inferring a predicate about the client input correctly. We develop a practical SBB protocol for image content, and evaluate its client privacy guarantee with real world social media data. We then combine SBB with various similarity protocols, showing that the combination with SBB provides a speedup of at least 29x on large scale databases compared to that without, while retaining correctness of over 95 .


Model adaptation in a discrete fracture network existence of solutions and numerical strategies. Fractures are normally present in the underground and are, for some physical processes, of paramount importance. Their accurate description is fundamental to obtain reliable numerical outcomes useful, e.g., for energy management. Depending on the physical and geometrical properties of the fractures, fluid flow can behave differently, going from a slow Darcian regime to more complicated Brinkman or even Forchheimer regimes for high velocity. The main problem is to determine where in the fractures one regime is more adequate than others. In order to determine these low speed and high speed regions, this work proposes an adaptive strategy which is based on selecting the appropriate constitutive law linking velocity and pressure according to a threshold criterion on the magnitude of the fluid velocity itself. Both theoretical and numerical aspects are considered and investigated, showing the potentiality of the proposed approach. From the analytical viewpoint, we show existence of weak solutions to such model under reasonable hypotheses on the constitutive laws. To this end, we use a variational approach identifying solutions with minimizers of an underlying energy functional. From the numerical viewpoint, we propose a one dimensional algorithm which tracks the interface between the low and high speed regions. By running numerical experiments using this algorithm, we illustrate some interesting behaviors of our adaptive model on a single fracture and small networks of intersecting fractures.


R2D2 Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling. Human language understanding operates at multiple levels of granularity (e.g., words, phrases, and sentences) with increasing levels of abstraction that can be hierarchically combined. However, existing deep models with stacked layers do not explicitly model any sort of hierarchical process. This paper proposes a recursive Transformer model based on differentiable CKY style binary trees to emulate the composition process. We extend the bidirectional language model pre training objective to this architecture, attempting to predict each word given its left and right abstraction nodes. To scale up our approach, we also introduce an efficient pruned tree induction algorithm to enable encoding in just a linear number of composition steps. Experimental results on language modeling and unsupervised parsing show the effectiveness of our approach.


Hamiltonian kinetic Hall Magnetohydrodynamics with fluid and kinetic ions in the current and pressure coupling schemes. We present two generalized hybrid kinetic Hall magnetohydrodynamics (MHD) models describing the interaction of a two fluid bulk plasma, which consists of thermal ions and electrons, with energetic, suprathermal ion populations described by Vlasov dynamics. The dynamics of the thermal components are governed by standard fluid equations in the Hall MHD limit with the electron momentum equation providing an Ohm's law with Hall and electron pressure terms involving a gyrotropic electron pressure tensor. The coupling of the bulk, low energy plasma with the energetic particle dynamics is accomplished through the current density (current coupling scheme CCS) and the ion pressure tensor appearing in the momentum equation (pressure coupling scheme PCS) in the first and the second model, respectively. The CCS is a generalization of two well known models, because in the limit of vanishing energetic and thermal ion densities we recover the standard Hall MHD and the hybrid kinetic ions fluid electron model, respectively. This provides us with the capability to study in a continuous manner the global impact of the energetic particles in a regime extending from vanishing to dominant energetic particle densities. The noncanonical Hamiltonian structures of the CCS and PCS, which can be exploited to study equilibrium and stability properties through the energy Casimir variational principle, are identified. As a first application here, we derive a generalized Hall MHD Grad Shafranov Bernoulli system for translationally symmetric equilibria with anisotropic electron pressure and kinetic effects owing to the presence of energetic particles using the PCS.


Estimating the Robustness of Classification Models by the Structure of the Learned Feature Space. Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this focus has been expanded by the notion of model robustness, ie the generalization abilities of models towards previously unseen changes in the data distribution. While new benchmarks, like ImageNet C, have been introduced to measure robustness properties, we argue that fixed testsets are only able to capture a small portion of possible data variations and are thus limited and prone to generate new overfitted solutions. To overcome these drawbacks, we suggest to estimate the robustness of a model directly from the structure of its learned feature space. We introduce robustness indicators which are obtained via unsupervised clustering of latent representations from a trained classifier and show very high correlations to the model performance on corrupted test data.


PCMPC Perception Constrained Model Predictive Control for Quadrotors with Suspended Loads using a Single Camera and IMU. In this paper, we address the Perception Constrained Model Predictive Control (PCMPC) and state estimation problems for quadrotors with cable suspended payloads using a single camera and Inertial Measurement Unit (IMU). We design a receding horizon control strategy for cable suspended payloads directly formulated on the system manifold configuration space SE(3)xS 2. The approach considers the system dynamics, actuator limits and the camera's Field Of View (FOV) constraint to guarantee the payload's visibility during motion. The monocular camera, IMU, and vehicle's motor speeds are combined to provide estimation of the vehicle's states in 3D space, the payload's states, the cable's direction and velocity. The proposed control and state estimation solution runs in real time at 500 Hz on a small quadrotor equipped with a limited computational unit. The approach is validated through experimental results considering a cable suspended payload trajectory tracking problem at different speeds.


Demonstration of Duality of Fractal Gravity Models by Scaling Symmetry. A pair of fractal gravity models can be derived from the spatial interaction models based on entropy maximizing principle and allometric scaling law. The models can be expressed as dual form in mathematics and are important for analyzing and predicting spatial flows in network of cities. However, the dual relationship of urban gravity parameters has been an empirical relationship for a long time and lacks theoretical proof. This paper is devoted to proving the duality of fractal gravity models by means of ideas from scaling invariance. The results show that a fractal gravity model can be derived from its dual form. The observational data of interurban spatial flows of Beijing Tianjin Hebei region of China are employed to make a case study, lending a further support to the theoretical derivation. A conclusion can be reached that the duality of gravity models rests with scaling symmetry of fractal structure. This work may be helpful for understanding the theoretical essence and application direction of spatial interaction modeling.


Data driven Weight Initialization with Sylvester Solvers. In this work, we propose a data driven scheme to initialize the parameters of a deep neural network. This is in contrast to traditional approaches which randomly initialize parameters by sampling from transformed standard distributions. Such methods do not use the training data to produce a more informed initialization. Our method uses a sequential layer wise approach where each layer is initialized using its input activations. The initialization is cast as an optimization problem where we minimize a combination of encoding and decoding losses of the input activations, which is further constrained by a user defined latent code. The optimization problem is then restructured into the well known Sylvester equation, which has fast and efficient gradient free solutions. Our data driven method achieves a boost in performance compared to random initialization methods, both before start of training and after training is over. We show that our proposed method is especially effective in few shot and fine tuning settings. We conclude this paper with analyses on time complexity and the effect of different latent codes on the recognition performance.


Context Aware Safe Reinforcement Learning for Non Stationary Environments. Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety constraints. However, few studies have addressed the non stationary disturbances in the environments, which may cause catastrophic outcomes. In this paper, we propose the context aware safe reinforcement learning (CASRL) method, a meta learning framework to realize safe adaptation in non stationary environments. We use a probabilistic latent variable model to achieve fast inference of the posterior environment transition distribution given the context data. Safety constraints are then evaluated with uncertainty aware trajectory sampling. The high cost of safety violations leads to the rareness of unsafe records in the dataset. We address this issue by enabling prioritized sampling during model training and formulating prior safety constraints with domain knowledge during constrained planning. The algorithm is evaluated in realistic safety critical environments with non stationary disturbances. Results show that the proposed algorithm significantly outperforms existing baselines in terms of safety and robustness.


Neural Fashion Image Captioning Accounting for Data Diversity. Image captioning has increasingly large domains of application, and fashion is not an exception. Having automatic item descriptions is of great interest for fashion web platforms, sometimes hosting hundreds of thousands of images. This paper is one of the first to tackle image captioning for fashion images. To address dataset diversity issues, we introduced the InFashAIv1 dataset containing almost 16.000 African fashion item images with their titles, prices, and general descriptions. We also used the well known DeepFashion dataset in addition to InFashAIv1. Captions are generated using the Show and Tell model made of CNN encoder and RNN Decoder. We showed that jointly training the model on both datasets improves captions quality for African style fashion images, suggesting a transfer learning from Western style data. The InFashAIv1 dataset is released on Github to encourage works with more diversity inclusion.


iNaturalist citizen science community during City Nature Challenge new computational approach for analysis of user activity. Analysing patterns of engagement among citizen science participants can provide important insights into the organisation and practice of individual citizen science projects. In particular, methods from statistics and network science can be used to understand different types of user behaviour and user interactions to help the further implementation and organization of community efforts. Using publicly available data from the iNaturalist community and their yearly City Nature Challenges (CNC) from 2017 2020 as an example we showcase computational methods to explore the spatio temporal evolution of this citizen science community that typically interacts in a hybrid offline online way. In particular, we investigate the user types present in the community along with their interactions, finding significant differences in usage behavior on both the level of engagement and the types of community tasks roles and how they interact with the network of contributors. We expect that these computational analysis strategies will be useful to gain further understanding of other citizen science communities and projects.


BigFoot Exploiting and Mitigating Leakage in Encrypted Write Ahead Logs. Modern databases and data warehousing systems separate query processing and durable storage. Storage systems have idiosyncratic bugs and security vulnerabilities, thus attacks that compromise only storage are a realistic threat. In this paper, we show that encryption alone is not sufficient to protect databases from compromised storage. Using MongoDB WiredTiger as a concrete example, we demonstrate that sizes of encrypted writes to a durable write ahead log can reveal sensitive information about the inputs and activities of MongoDB applications. We then design, implement, and evaluate BigFoot, a WAL modification that mitigates size leakage.


DeepMI A Mutual Information Based Framework For Unsupervised Deep Learning of Tasks. In this work, we propose an information theory based framework DeepMI to train deep neural networks (DNN) using Mutual Information (MI). The DeepMI framework is especially targeted but not limited to the learning of real world tasks in an unsupervised manner. The primary motivation behind this work is the limitation of the traditional loss functions for unsupervised learning of a given task. Directly using MI for the training purpose is quite challenging to deal with because of its unbounded above nature. Hence, we develop an alternative linearized representation of MI as a part of the framework. Contributions of this paper are three fold i) investigation of MI to train deep neural networks, ii) novel loss function LLMI , and iii) a fuzzy logic based end to end differentiable pipeline to integrate DeepMI into deep learning framework. Due to the unavailability of a standard benchmark, we carefully design the experimental analysis and select three different tasks for the experimental study. We demonstrate that L LMI alone provides better gradients to achieve a neural network better performance over the popular loss functions, also in the cases when multiple loss functions are used for a given task.


Does Optimal Source Task Performance Imply Optimal Pre training for a Target Task?. Fine tuning of pre trained deep nets is commonly used to improve accuracies and training times for neural nets. It is generally assumed that pre training a net for optimal source task performance best prepares it for fine tuning to learn an arbitrary target task. This is generally not true. Stopping source task training, prior to optimal performance, can create a pre trained net better suited for fine tuning to learn a new task. We perform several experiments demonstrating this effect, as well as the influence of the amount of training and of learning rate. Additionally, our results indicate that this reflects a general loss of learning ability that even extends to relearning the source task.


Adaptive Streaming Perception using Deep Reinforcement Learning. Executing computer vision models on streaming visual data, or streaming perception is an emerging problem, with applications in self driving, embodied agents, and augmented virtual reality. The development of such systems is largely governed by the accuracy and latency of the processing pipeline. While past work has proposed numerous approximate execution frameworks, their decision functions solely focus on optimizing latency, accuracy, or energy, etc. This results in sub optimum decisions, affecting the overall system performance. We argue that the streaming perception systems should holistically maximize the overall system performance (i.e., considering both accuracy and latency simultaneously). To this end, we describe a new approach based on deep reinforcement learning to learn these tradeoffs at runtime for streaming perception. This tradeoff optimization is formulated as a novel deep contextual bandit problem and we design a new reward function that holistically integrates latency and accuracy into a single metric. We show that our agent can learn a competitive policy across multiple decision dimensions, which outperforms state of the art policies on public datasets.


Turing Tumble is Turing Complete. It is shown that the toy Turing Tumble, suitably extended with an infinitely long game board and unlimited supply of pieces, is Turing Complete. This is achieved via direct simulation of a Turing machine. Unlike previously informally presented constructions, we do not encode the finite control infinitely many times, we need only one trigger ball hopper pair, and we prove our construction correct. We believe this is the first natural extension of a marble based computer that has been shown to be universal.


Using a GAN to Generate Adversarial Examples to Facial Image Recognition. Images posted online present a privacy concern in that they may be used as reference examples for a facial recognition system. Such abuse of images is in violation of privacy rights but is difficult to counter. It is well established that adversarial example images can be created for recognition systems which are based on deep neural networks. These adversarial examples can be used to disrupt the utility of the images as reference examples or training data. In this work we use a Generative Adversarial Network (GAN) to create adversarial examples to deceive facial recognition and we achieve an acceptable success rate in fooling the face recognition. Our results reduce the training time for the GAN by removing the discriminator component. Furthermore, our results show knowledge distillation can be employed to drastically reduce the size of the resulting model without impacting performance indicating that our contribution could run comfortably on a smartphone


ACK Less Rate Adaptation for IEEE 802.11bc Enhanced Broadcast Services Using Sim to Real Deep Reinforcement Learning. In IEEE 802.11bc, the broadcast mode on wireless local area networks (WLANs), data rate control that is based on acknowledgement (ACK) mechanism similar to the one in the current IEEE 802.11 WLANs is not applicable because ACK mechanism is not implemented. This paper addresses this challenge by proposing ACK less data rate adaptation methods by capturing non broadcast uplink frames of STAs. In IEEE 802.11bc, an use case is assumed, where a part of STAs in the broadcast recipients is also associated with non broadcast APs, and such STAs periodically transmit uplink frames including ACK frames. The proposed method is based on the idea that by overhearing such uplink frames, the broadcast AP surveys channel conditions at partial STAs, thereby setting appropriate data rates for the STAs. Furthermore, in order to avoid reception failures in a large portion of STAs, this paper proposes deep reinforcement learning (DRL) based data rate adaptation framework that uses a sim to real approach. Therein, information of reception success failure at broadcast recipient STAs, that could not be notified to the broadcast AP in real deployments, are made available by simulations beforehand, thereby forming data rate adaptation strategies. Numerical results show that utilizing overheard uplink frames of recipients makes it feasible to manage data rates in ACK less broadcast WLANs, and using the sim to real DRL framework can decrease reception failures.


Generative Adversarial Networks for Labelled Vibration Data Generation. As Structural Health Monitoring (SHM) being implemented more over the years, the use of operational modal analysis of civil structures has become more significant for the assessment and evaluation of engineering structures. Machine Learning (ML) and Deep Learning (DL) algorithms have been in use for structural damage diagnostics of civil structures in the last couple of decades. While collecting vibration data from civil structures is a challenging and expensive task for both undamaged and damaged cases, in this paper, the authors are introducing Generative Adversarial Networks (GAN) that is built on the Deep Convolutional Neural Network (DCNN) and using Wasserstein Distance for generating artificial labelled data to be used for structural damage diagnostic purposes. The authors named the developed model 1D W DCGAN and successfully generated vibration data which is very similar to the input. The methodology presented in this paper will pave the way for vibration data generation for numerous future applications in the SHM domain.


Machamp A Generalized Entity Matching Benchmark. Entity Matching (EM) refers to the problem of determining whether two different data representations refer to the same real world entity. It has been a long standing interest of the data management community and many efforts have been paid in creating benchmark tasks as well as in developing advanced matching techniques. However, existing benchmark tasks for EM are limited to the case where the two data collections of entities are structured tables with the same schema. Meanwhile, the data collections for matching could be structured, semi structured, or unstructured in real world scenarios of data science. In this paper, we come up with a new research problem Generalized Entity Matching to satisfy this requirement and create a benchmark Machamp for it. Machamp consists of seven tasks having diverse characteristics and thus provides good coverage of use cases in real applications. We summarize existing EM benchmark tasks for structured tables and conduct a series of processing and cleaning efforts to transform them into matching tasks between tables with different structures. Based on that, we further conduct comprehensive profiling of the proposed benchmark tasks and evaluate popular entity matching approaches on them. With the help of Machamp, it is the first time that researchers can evaluate EM techniques between data collections with different structures.


Towards Robust Reasoning over Knowledge Graphs. Answering complex logical queries over large scale knowledge graphs (KGs) represents an important artificial intelligence task, entailing a range of applications. Recently, knowledge representation learning (KRL) has emerged as the state of the art approach, wherein KG entities and the query are embedded into a latent space such that entities that answer the query are embedded close to the query. Yet, despite its surging popularity, the potential security risks of KRL are largely unexplored, which is concerning, given the increasing use of such capabilities in security critical domains (e.g., cyber security and healthcare). This work represents a solid initial step towards bridging this gap. We systematize the potential security threats to KRL according to the underlying attack vectors (e.g., knowledge poisoning and query perturbation) and the adversary's background knowledge. More importantly, we present ROAR(Reasoning Over Adversarial Representations), a new class of attacks that instantiate a variety of such threats. We demonstrate the practicality of ROAR in two representative use cases (i.e., cyber threat hunting and drug repurposing). For instance, ROAR attains over 99 attack success rate in misleading the threat intelligence engine to give pre defined answers for target queries, yet without any impact on non target ones. Further, we discuss potential countermeasures against ROAR, including filtering of poisoning facts and robust training with adversarial queries, which leads to several promising research directions.


Fixed point iterative linear inverse solver with extended precision. Solving linear systems is a ubiquitous task in science and engineering. Because directly inverting a large scale linear system can be computationally expensive, iterative algorithms are often used to numerically find the inverse. To accommodate the dynamic range and precision requirements, these iterative algorithms are often carried out on floating point processing units. Low precision, fixed point processors require only a fraction of the energy per operation consumed by their floating point counterparts, yet their current usages exclude iterative solvers due to the computational errors arising from fixed point arithmetic. In this work, we show that for a simple iterative algorithm, such as Richardson iteration, using a fixed point processor can provide the same rate of convergence and achieve high precision solutions beyond its native precision limit when combined with residual iteration. These results indicate that power efficient computing platform consisting of analog computing devices can be used to solve a broad range of problems without compromising the speed or precision.


A pressure based diffuse interface method for low Mach multiphase flows with mass transfer. This study presents a novel pressure based methodology for the efficient numerical solution of a four equation two phase diffuse interface model. The proposed methodology has the potential to simulate low Mach flows with mass transfer. In contrast to the classical conservative four equation model formulation, the adopted set of equations features volume fraction, temperature, velocity and pressure as the primary variables. The model includes the effects of viscosity, surface tension, thermal conductivity and gravity, and has the ability to incorporate complex equations of state. Additionally, a Gibbs free energy relaxation procedure is used to model mass transfer. A key characteristic of the proposed methodology is the use of high performance and scalable solvers for the solution of the Helmholtz equation for the pressure, which drastically reduces the computational cost compared to analogous density based approaches. We demonstrate the capabilities of the methodology to simulate flows with large density and viscosity ratios through extended verification against a range of different test cases. Finally, the potential of the methodology to tackle challenging phase change flows is demonstrated with the simulation of three dimensional nucleate boiling.


News Kaleidoscope Visual Investigation of Coverage Diversity in News Event Reporting. We develop a visual analytics system, NewsKaleidoscope, to investigate the how news reporting of events varies. NewsKaleidoscope combines several backend text language processing techniques with a coordinated visualization interface tailored for visualization non expert users. To robustly evaluate NewsKaleidoscope, we conduct a trio of user studies. (1) A usability study with news novices assesses the overall system and the specific insights promoted for journalism agnostic users. (2) A follow up study with news experts assesses the insights promoted for journalism savvy users. (3) Based on identified system limitations in these two studies, we amend NewsKaleidoscope design and conduct a third study to validate these improvements. Results indicate that, for both news novice and experts, NewsKaleidoscope supports an effective, task driven workflow for analyzing the diversity of news coverage about events, though journalism expertise has a significant influence on the user insights and takeaways. Our insights while developing and evaluating NewsKaleidoscope can aid future interface designs that combine visualization with natural language processing to analyze coverage diversity in news event reporting.


Finite dimensional construction of self duality and related moduli spaces over a closed Riemann surface as stratified holomorphic symplectic spaces. In terms of appropriate extended moduli spaces, we develop a finite dimensional construction of the self duality and related moduli spaces over a closed Riemann surface as stratified holomorphic symplectic spaces by singular finite dimensional holomorphic symplectic reduction.


Runtime Analysis of RLS and the (1 1) EA for the Chance constrained Knapsack Problem with Correlated Uniform Weights. Addressing a complex real world optimization problem is a challenging task. The chance constrained knapsack problem with correlated uniform weights plays an important role in the case where dependent stochastic components are considered. We perform runtime analysis of a randomized search algorithm (RSA) and a basic evolutionary algorithm (EA) for the chance constrained knapsack problem with correlated uniform weights. We prove bounds for both algorithms for producing a feasible solution. Furthermore, we investigate the behavior of the algorithms and carry out analyses on two settings uniform profit value and the setting in which every group shares an arbitrary profit profile. We provide insight into the structure of these problems and show how the weight correlations and the different types of profit profiles influence the runtime behavior of both algorithms in the chance constrained setting.


Interface Retaining Coarsening of Multiphase Flows. Multiphase flows are characterized by sharp moving interfaces, separating different fluids or phases. In many cases the dynamics of the interface determines the behavior of the flow. In a coarse, or reduced order model, it may therefore be important to retain a sharp interface for the resolved scales. Here, a process to coarsen or filter fully resolved numerical solutions for incompressible multiphase flows while retaining a sharp interface is examined. The different phases are identified by an index function that takes different values in each phase and is coarsened by solving a constant coefficient diffusion equation, while tracking the interface contour. Small flows scales of one phase, left behind when the interface is moved, are embedded in the other phase by solving another diffusion equation with a modified diffusion coefficient that is zero at the interface location to prevent diffusion across the interface, plus a pressure like equation to enforce incompressibility of the coarse velocity field. Examples of different levels of coarsening are shown. A simulation of a coarse model, where small scales are treated as a homogeneous mixture, results in a solution that is similar to the filtered fully resolved field for the early time Rayleigh Taylor instability.


Fuglede's conjecture holds in mathbb Z p times mathbb Z p n . Fuglede's conjecture states that for a subset Omega of a locally compact abelian group G with positive and finite Haar measure, there exists a subset of the dual group of G which is an orthogonal basis of L 2 ( Omega) if and only if it tiles the group by translation. In this paper, we prove a divisibility property for a set in mathbb Z p times mathbb Z p n . Then using the divisibility property and equi distributed property, we prove that Fuglede's conjecture holds in the group mathbb Z p times mathbb Z p n .


FitVid Overfitting in Pixel Level Video Prediction. An agent that is capable of predicting what happens next can perform a variety of tasks through planning with no additional training. Furthermore, such an agent can internally represent the complex dynamics of the real world and therefore can acquire a representation useful for a variety of visual perception tasks. This makes predicting the future frames of a video, conditioned on the observed past and potentially future actions, an interesting task which remains exceptionally challenging despite many recent advances. Existing video prediction models have shown promising results on simple narrow benchmarks but they generate low quality predictions on real life datasets with more complicated dynamics or broader domain. There is a growing body of evidence that underfitting on the training data is one of the primary causes for the low quality predictions. In this paper, we argue that the inefficient use of parameters in the current video models is the main reason for underfitting. Therefore, we introduce a new architecture, named FitVid, which is capable of severe overfitting on the common benchmarks while having similar parameter count as the current state of the art models. We analyze the consequences of overfitting, illustrating how it can produce unexpected outcomes such as generating high quality output by repeating the training data, and how it can be mitigated using existing image augmentation techniques. As a result, FitVid outperforms the current state of the art models across four different video prediction benchmarks on four different metrics.


Corporate core values and social responsibility What really matters to whom. This study uses an innovative measure, the Semantic Brand Score, to assess the interest of stakeholders in different company core values. Among others, we focus on corporate social responsibility (CSR) core value statements, and on the attention they receive from five categories of stakeholders (customers, company communication teams, employees, associations and media). Combining big data methods and tools of Social Network Analysis and Text Mining, we analyzed about 58,000 Italian tweets and found that different stakeholders have different prevailing interests. CSR gets much less attention than expected. Core values related to customers and employees are in the foreground.


On the Structure of Periodic Eigenvalues of the Vectorial p Laplacian. In this paper we will solve an open problem raised by Man 'asevich and Mawhin twenty years ago on the structure of the periodic eigenvalues of the vectorial p Laplacian. This is an Euler Lagrangian equation on the plane or in higher dimensional Euclidean spaces. The main result obtained is that for any exponent p other than 2 , the vectorial p Laplacian on the plane will admit infinitely many different sequences of periodic eigenvalues with a given period. These sequences of eigenvalues are constructed using the notion of scaling momenta we will introduce. The whole proof is based on the complete integrability of the equivalent Hamiltonian system, the tricky reduction to 2 dimensional dynamical systems, and a number theoretical distinguishing between different sequences of eigenvalues. Some numerical simulations to the new sequences of eigenvalues and eigenfunctions will be given. Several further conjectures towards to the panorama of the spectral sets will be imposed.


Performance Variability in Zero Shot Classification. Zero shot classification (ZSC) is the task of learning predictors for classes not seen during training. Although the different methods in the literature are evaluated using the same class splits, little is known about their stability under different class partitions. In this work we show experimentally that ZSC performance exhibits strong variability under changing training setups. We propose the use ensemble learning as an attempt to mitigate this phenomena.


Dynamic quenching of a single photon avalanche photodetector using an adaptive resistive switch. One of the most common approaches for quenching single photon avalanche diodes is to use a passive resistor in series with it. A drawback of this approach has been the limited recovery speed of the single photon avalanche diodes. High resistance is needed to quench the avalanche, leading to slower recharging of the single photon avalanche diodes depletion capacitor. We address this issue by replacing a fixed quenching resistor with a bias dependent adaptive resistive switch. Reversible generation of metallic conduction enables switching between low and high resistance states under unipolar bias. As an example, using a Pt Al2O3 Ag resistor with a commercial silicon single photon avalanche diodes, we demonstrate avalanche pulse widths as small as 30 ns, 10x smaller than a passively quenched approach, thus significantly improving the single photon avalanche diodes frequency response. The experimental results are consistent with a model where the adaptive resistor dynamically changes its resistance during discharging and recharging the single photon avalanche diodes.


No RL, No Simulation Learning to Navigate without Navigating. Most prior methods for learning navigation policies require access to simulation environments, as they need online policy interaction and rely on ground truth maps for rewards. However, building simulators is expensive (requires manual effort for each and every scene) and creates challenges in transferring learned policies to robotic platforms in the real world, due to the sim to real domain gap. In this paper, we pose a simple question Do we really need active interaction, ground truth maps or even reinforcement learning (RL) in order to solve the image goal navigation task? We propose a self supervised approach to learn to navigate from only passive videos of roaming. Our approach, No RL, No Simulator (NRNS), is simple and scalable, yet highly effective. NRNS outperforms RL based formulations by a significant margin. We present NRNS as a strong baseline for any future image based navigation tasks that use RL or Simulation.


Continuous data assimilation and long time accuracy in a C 0 interior penalty method for the Cahn Hilliard equation. We propose a numerical approximation method for the Cahn Hilliard equations that incorporates continuous data assimilation in order to achieve long time accuracy. The method uses a C 0 interior penalty spatial discretization of the fourth order Cahn Hilliard equations, together with a backward Euler temporal discretization. We prove the method is long time stable and long time accurate, for arbitrarily inaccurate initial conditions, provided enough data measurements are incorporated into the simulation. Numerical experiments illustrate the effectiveness of the method on a benchmark test problem.


Artificial intelligence for Sustainable Energy A Contextual Topic Modeling and Content Analysis. Parallel to the rising debates over sustainable energy and artificial intelligence solutions, the world is currently discussing the ethics of artificial intelligence and its possible negative effects on society and the environment. In these arguments, sustainable AI is proposed, which aims at advancing the pathway toward sustainability, such as sustainable energy. In this paper, we offered a novel contextual topic modeling combining LDA, BERT, and Clustering. We then combined these computational analyses with content analysis of related scientific publications to identify the main scholarly topics, sub themes, and cross topic themes within scientific research on sustainable AI in energy. Our research identified eight dominant topics including sustainable buildings, AI based DSSs for urban water management, climate artificial intelligence, Agriculture 4, the convergence of AI with IoT, AI based evaluation of renewable technologies, smart campus and engineering education, and AI based optimization. We then recommended 14 potential future research strands based on the observed theoretical gaps. Theoretically, this analysis contributes to the existing literature on sustainable AI and sustainable energy, and practically, it intends to act as a general guide for energy engineers and scientists, AI scientists, and social scientists to widen their knowledge of sustainability in AI and energy convergence research.


Elastic drifted Brownian motions and non local boundary conditions. We provide a deep connection between elastic drifted Brownian motions and inverses to tempered subordinators. Based on this connection, we establish a link between multiplicative functionals and dynamical boundary conditions given in terms of non local equations in time. Indeed, we show that the multiplicative functional associated to the elastic Brownian motion with drift is equivalent to a multiplicative functional associated with fractional boundary conditions of tempered type. By exploiting such connection we write some functionals in terms of a simple (positive and non decreasing) process. In our view, such a representation is useful in many applications.


Machine Learning Applications on Neuroimaging for Diagnosis and Prognosis of Epilepsy A Review. Machine learning is playing an increasingly important role in medical image analysis, spawning new advances in the clinical application of neuroimaging. There have been some reviews on machine learning and epilepsy before, and they mainly focused on electrophysiological signals such as electroencephalography (EEG) and stereo electroencephalography (SEEG), while neglecting the potential of neuroimaging in epilepsy research. Neuroimaging has its important advantages in confirming the range of the epileptic region, which is essential in presurgical evaluation and assessment after surgery. However, it is difficult for EEG to locate the accurate epilepsy lesion region in the brain. In this review, we emphasize the interaction between neuroimaging and machine learning in the context of epilepsy diagnosis and prognosis. We start with an overview of epilepsy and typical neuroimaging modalities used in epilepsy clinics, MRI, DWI, fMRI, and PET. Then, we elaborate two approaches in applying machine learning methods to neuroimaging data i) the conventional machine learning approach combining manual feature engineering and classifiers, ii) the deep learning approach, such as the convolutional neural networks and autoencoders. Subsequently, the application of machine learning on epilepsy neuroimaging, such as segmentation, localization, and lateralization tasks, as well as tasks directly related to diagnosis and prognosis are looked into in detail. Finally, we discuss the current achievements, challenges, and potential future directions in this field, hoping to pave the way for computer aided diagnosis and prognosis of epilepsy.


Evaluating Disentanglement of Structured Representations. We introduce the first metric for evaluating disentanglement at individual hierarchy levels of a structured latent representation. Applied to object centric generative models, this offers a systematic, unified approach to evaluating (i) object separation between latent slots (ii) disentanglement of object properties inside individual slots (iii) disentanglement of intrinsic and extrinsic object properties. We theoretically show that for structured representations, our framework gives stronger guarantees of selecting a good model than previous disentanglement metrics. Experimentally, we demonstrate that viewing object compositionality as a disentanglement problem addresses several issues with prior visual metrics of object separation. As a core technical component, we present the first representation probing algorithm handling slot permutation invariance.


Cone theorem and Mori hyperbolicity. We discuss the cone theorem for quasi log schemes and the Mori hyperbolicity. In particular, we establish that the log canonical divisor of a Mori hyperbolic projective normal pair is nef if it is nef when restricted to the non lc locus. This answers Svaldi's question completely. We also treat the uniruledness of the degenerate locus of an extremal contraction morphism for quasi log schemes. Furthermore, we prove that every fiber of a relative quasi log Fano scheme is rationally chain connected modulo the non qlc locus.


Congruency Constrained TU Problems Beyond the Bimodular Case. A long standing open question in Integer Programming is whether integer programs with constraint matrices with bounded subdeterminants are efficiently solvable. An important special case thereof are congruency constrained integer programs min c top x colon Tx leq b, gamma top x equiv r pmod m , x in mathbb Z n with a totally unimodular constraint matrix T . Such problems have been shown to be polynomial time solvable for m 2 , which led to an efficient algorithm for integer programs with bimodular constraint matrices, i.e., full rank matrices whose n times n subdeterminants are bounded by two in absolute value. Whereas these advances heavily relied on existing results on well known combinatorial problems with parity constraints, new approaches are needed beyond the bimodular case, i.e., for m 2 . We make first progress in this direction through several new techniques. In particular, we show how to efficiently decide feasibility of congruency constrained integer programs with a totally unimodular constraint matrix for m 3 . Furthermore, for general m , our techniques also allow for identifying flat directions of infeasible problems, and deducing bounds on the proximity between solutions of the problem and its relaxation.


Introducing OpenMP Tasks into the HYDRO Benchmark. The HYDRO mini application has been successfully used as a research vehicle in previous PRACE projects 6 . In this paper, we evaluate the benefits of the tasking model introduced in recent OpenMP standards 9 . We have developed a new version of HYDRO using the concept of OpenMP tasks and this implementation is compared to already existing and optimized OpenMP versions of HYDRO.


Spatiotemporal Spike Pattern Selectivity in Single Mixed Signal Neurons with Balanced Synapses. Realizing the potential of mixed signal neuromorphic processors for ultra low power inference and learning requires efficient use of their inhomogeneous analog circuitry as well as sparse, time based information encoding and processing. Here, we investigate spike timing based spatiotemporal receptive fields of output neurons in the Spatiotemporal Correlator (STC) network, for which we used excitatory inhibitory balanced disynaptic inputs instead of dedicated axonal or neuronal delays. We present hardware in the loop experiments with a mixed signal DYNAP SE neuromorphic processor, in which five dimensional receptive fields of hardware neurons were mapped by randomly sampling input spike patterns from a uniform distribution. We find that, when the balanced disynaptic elements are randomly programmed, some of the neurons display distinct receptive fields. Furthermore, we demonstrate how a neuron was tuned to detect a particular spatiotemporal feature, to which it initially was non selective, by activating a different subset of the inhomogeneous analog synaptic circuits. The energy dissipation of the balanced synaptic elements is one order of magnitude lower per lateral connection (0.65 nJ vs 9.3 nJ per spike) than former delay based neuromorphic hardware implementations. Thus, we show how the inhomogeneous synaptic circuits could be utilized for resource efficient implementation of STC network layers, in a way that enables synapse address reprogramming as a discrete mechanism for feature tuning.


Energy Efficiency Optimization of Reconfigurable Intelligent Surfaces with Electromagnetic Field Exposure Constraints. This work considers the problem of energy efficiency maximization in a RIS based communication link, subject to not only the conventional maximum power constraints, but also additional constraints on the maximum exposure to electromagnetic radiations of the end users. The RIS phase shifts, the transmit beamforming, the linear receive filter, and the transmit power are jointly optimized, and two provably convergent and low complexity algorithms are developed. One algorithm can be applied to the general system setups, but does not guarantee global optimality. The second algorithm is provably optimal in a notable special case. The numerical results show that RIS based communications can ensure high energy efficiency while fulfilling users' exposure constraints to radio frequency emissions.


Integer decomposition property of polytopes. We study the integer decomposition property of lattice polytopes associated with the n dimensional smooth complete fans with at most n 3 rays. Using the classification of smooth complete fans by Kleinschmidt and Batyrev and a reduction to lower dimensional polytopes we prove the integer decomposition property for lattice polytopes in this setting.


Conceptual Data Modeling Entity Relationship Models as Thinging Machines. Data modeling is a process of developing a model to design and develop a data system that supports an organization s various business processes. A conceptual data model represents a technology independent specification of structure of data to be stored within a database. The model aims at providing richer expressiveness and incorporating a set of semantics to (a) support the design, control, and integrity parts of the data stored in data management structures and (b) coordinate viewing of connections and ideas on a database. The described structure of the data is often represented in an entity relationship (ER) model, which was one of the first data modeling techniques and is likely to continue to be a popular way of characterizing entity classes, attributes and relationships. This paper is an attempt to examine the basic ER modeling notions to analyze the concepts to which they refer as well as ways to represent them. In such a mission, we apply a new modeling methodology (thinging machine TM) to ER in terms of its fundamental building constructs, representation entities, relationships and attributes. The goal of this venture is to further the understanding of data models and enrich their semantics. Three specific contributions to modeling in this context are incorporated (a) using the TM model s five generic actions to inject processing in the ER structure (b) relating the single ontological element of TM modeling (i.e., a thing machine or thimac) to ER entities and relationships and (c) proposing a high level integrated, extended ER model that includes structural and time oriented notions (e.g., events or behavior).


The geometry of one weight codes in the sum rank metric. We provide a geometric characterization of k dimensional mathbb F q m linear sum rank metric codes as tuples of mathbb F q subspaces of mathbb F q m k . We then use this characterization to study one weight codes in the sum rank metric. This leads us to extend the family of linearized Reed Solomon codes in order to obtain a doubly extended version of them. We prove that these codes are still maximum sum rank distance (MSRD) codes and, when k 2 , they are one weight, as in the Hamming metric case. We then focus on constant rank profile codes in the sum rank metric, which are a special family of one weight codes, and derive constraints on their parameters with the aid of an associated Hamming metric code. Furthermore, we introduce the n simplex codes in the sum rank metric, which are obtained as the orbit of a Singer subgroup of mathrm GL (k,q m) . They turn out to be constant rank profile and hence one weight and generalize the simplex codes in both the Hamming and the rank metric. Finally, we focus on 2 dimensional one weight codes, deriving constraints on the parameters of those which are also MSRD, and we find a new construction of one weight MSRD codes when q 2 .


Learning to Transpile AMR into SPARQL. We propose a transition based system to transpile Abstract Meaning Representation (AMR) into SPARQL for Knowledge Base Question Answering (KBQA). This allows to delegate part of the abstraction problem to a strongly pre trained semantic parser, while learning transpiling with small amount of paired data. We departure from recent work relating AMR and SPARQL constructs, but rather than applying a set of rules, we teach the BART model to selectively use these relations. Further, we avoid explicitly encoding AMR but rather encode the parser state in the attention mechanism of BART, following recent semantic parsing works. The resulting model is simple, provides supporting text for its decisions, and outperforms recent progress in AMR based KBQA in LC QuAD (F1 53.4), matching it in QALD (F1 30.8), while exploiting the same inductive biases.


Characterising rectifiable metric spaces using tangent spaces. We characterise rectifiable subsets of a complete metric space X in terms of local approximation, with respect to the Gromov Hausdorff distance, by an n dimensional Banach space. In fact, if E subset X with mathcal H n(E) infty and has positive lower density almost everywhere, we prove that it is sufficient that, at almost every point and each sufficiently small scale, E is approximated by a bi Lipschitz image of Euclidean space. We also introduce a generalisation of Preiss's tangent measures that is suitable for the setting of arbitrary metric spaces and formulate our characterisation in terms of tangent measures. This definition is equivalent to that of Preiss when the ambient space is Euclidean, and equivalent to the measured Gromov Hausdorff tangent space when the measure is doubling.


Combat Data Shift in Few shot Learning with Knowledge Graph. Many few shot learning approaches have been designed under the meta learning framework, which learns from a variety of learning tasks and generalizes to new tasks. These meta learning approaches achieve the expected performance in the scenario where all samples are drawn from the same distributions (i.i.d. observations). However, in real world applications, few shot learning paradigm often suffers from data shift, i.e., samples in different tasks, even in the same task, could be drawn from various data distributions. Most existing few shot learning approaches are not designed with the consideration of data shift, and thus show downgraded performance when data distribution shifts. However, it is non trivial to address the data shift problem in few shot learning, due to the limited number of labeled samples in each task. Targeting at addressing this problem, we propose a novel metric based meta learning framework to extract task specific representations and task shared representations with the help of knowledge graph. The data shift within between tasks can thus be combated by the combination of task shared and task specific representations. The proposed model is evaluated on popular benchmarks and two constructed new challenging datasets. The evaluation results demonstrate its remarkable performance.


Fast Exploration of Weight Sharing Opportunities for CNN Compression. The computational workload involved in Convolutional Neural Networks (CNNs) is typically out of reach for low power embedded devices. There are a large number of approximation techniques to address this problem. These methods have hyper parameters that need to be optimized for each CNNs using design space exploration (DSE). The goal of this work is to demonstrate that the DSE phase time can easily explode for state of the art CNN. We thus propose the use of an optimized exploration process to drastically reduce the exploration time without sacrificing the quality of the output.


Learning Contrastive Representation for Semantic Correspondence. Dense correspondence across semantically related images has been extensively studied, but still faces two challenges 1) large variations in appearance, scale and pose exist even for objects from the same category, and 2) labeling pixel level dense correspondences is labor intensive and infeasible to scale. Most existing approaches focus on designing various matching approaches with fully supervised ImageNet pretrained networks. On the other hand, while a variety of self supervised approaches are proposed to explicitly measure image level similarities, correspondence matching the pixel level remains under explored. In this work, we propose a multi level contrastive learning approach for semantic matching, which does not rely on any ImageNet pretrained model. We show that image level contrastive learning is a key component to encourage the convolutional features to find correspondence between similar objects, while the performance can be further enhanced by regularizing cross instance cycle consistency at intermediate feature levels. Experimental results on the PF PASCAL, PF WILLOW, and SPair 71k benchmark datasets demonstrate that our method performs favorably against the state of the art approaches. The source code and trained models will be made available to the public.


A Neural Network Based Linguistic Similarity Measure for Entrainment in Conversations. Linguistic entrainment is a phenomenon where people tend to mimic each other in conversation. The core instrument to quantify entrainment is a linguistic similarity measure between conversational partners. Most of the current similarity measures are based on bag of words approaches that rely on linguistic markers, ignoring the overall language structure and dialogue context. To address this issue, we propose to use a neural network model to perform the similarity measure for entrainment. Our model is context aware, and it further leverages a novel component to learn the shared high level linguistic features across dialogues. We first investigate the effectiveness of our novel component. Then we use the model to perform similarity measure in a corpus based entrainment analysis. We observe promising results for both evaluation tasks.


Free space Realization of Tunable Pin like Optical Vortex Beams. We demonstrate, both analytically and experimentally, free space pin like optical vortex beams (POVBs).Such angular momentum carrying beams feature tunable peak intensity and undergo robust anti diffracting propagation, realized by judiciously modulating both the amplitude and the phase profile of a standard laser beam. Specifically, they are generated by superimposing a radially symmetric power law phase on a helical phase structure, which allows the inclusion of an orbital angular momentum term to the POVBs. During propagation in free space, these POVBs initially exhibit autofocusing dynamics, and subsequently, their amplitude patterns morph into a high order Bessel like profile characterized by a hollow core and an annular main lobe with a constant or tunable width during propagation. In contrast with numerous previous endeavors on Bessel beams, our work represents the first demonstration of long distance free space generation of optical vortex 'pins', with their peak intensity evolution controlled by the impressed amplitude structure. Both the Poynting vectors and the optical radiation forces associated with these beams are also numerically analyzed, revealing novel properties that may be useful for a wide range of applications.


Stereo Matching Based on Visual Sensitive Information. The area of computer vision is one of the most discussed topics amongst many scholars, and stereo matching is its most important sub fields. After the parallax map is transformed into a depth map, it can be applied to many intelligent fields. In this paper, a stereo matching algorithm based on visual sensitive information is proposed by using standard images from Middlebury dataset. Aiming at the limitation of traditional stereo matching algorithms regarding the cost window, a cost aggregation algorithm based on the dynamic window is proposed, and the disparity image is optimized by using left and right consistency detection to further reduce the error matching rate. The experimental results show that the proposed algorithm can effectively enhance the stereo matching effect of the image providing significant improvement in accuracy as compared with the classical census algorithm. The proposed model code, dataset, and experimental results are available at https github.com WangHewei16 Stereo Matching.


Mixed quantifier prefixes over Diophantine equations with integer variables. In this paper we study mixed quantifier prefixes over Diophantine equations with integer variables. For example, we prove that forall 2 exists 4 over mathbb Z is undecidable, that is, there is no algorithm to determine for any P(x 1, ldots,x 6) in mathbb Z x 1, ldots,x 6 whether forall x 1 forall x 2 exists x 3 exists x 4 exists x 5 exists x 6(P(x 1, ldots,x 6) 0), where x 1, ldots,x 6 are integer variables. We also have some similar undecidable results with universal quantifies bounded, for example, exists 2 forall 2 exists 2 over mathbb Z with forall bounded is undecidable. We conjecture that forall 2 exists 2 over mathbb Z is undecidable.


Maximum Entropy on Erroneous Predictions (MEEP) Improving model calibration for medical image segmentation. Modern deep neural networks have achieved remarkable progress in medical image segmentation tasks. However, it has recently been observed that they tend to produce overconfident estimates, even in situations of high uncertainty, leading to poorly calibrated and unreliable models. In this work we introduce Maximum Entropy on Erroneous Predictions (MEEP), a training strategy for segmentation networks which selectively penalizes overconfident predictions, focusing only on misclassified pixels. In particular, we design a regularization term that encourages high entropy posteriors for wrong predictions, increasing the network uncertainty in complex scenarios. Our method is agnostic to the neural architecture, does not increase model complexity and can be coupled with multiple segmentation loss functions. We benchmark the proposed strategy in two challenging medical image segmentation tasks white matter hyperintensity lesions in magnetic resonance images (MRI) of the brain, and atrial segmentation in cardiac MRI. The experimental results demonstrate that coupling MEEP with standard segmentation losses leads to improvements not only in terms of model calibration, but also in segmentation quality.


Large Scale Unsupervised Person Re Identification with Contrastive Learning. Existing public person Re Identification (ReID) datasets are small in modern terms because of labeling difficulty. Although unlabeled surveillance video is abundant and relatively easy to obtain, it is unclear how to leverage these footage to learn meaningful ReID representations. In particular, most existing unsupervised and domain adaptation ReID methods utilize only the public datasets in their experiments, with labels removed. In addition, due to small data sizes, these methods usually rely on fine tuning by the unlabeled training data in the testing domain to achieve good performance. Inspired by the recent progress of large scale self supervised image classification using contrastive learning, we propose to learn ReID representation from large scale unlabeled surveillance video alone. Assisted by off the shelf pedestrian detection tools, we apply the contrastive loss at both the image and the tracklet levels. Together with a principal component analysis step using camera labels freely available, our evaluation using a large scale unlabeled dataset shows far superior performance among unsupervised methods that do not use any training data in the testing domain. Furthermore, the accuracy improves with the data size and therefore our method has great potential with even larger and more diversified datasets.


Determinantal Beam Search. Beam search is a go to strategy for decoding neural sequence models. The algorithm can naturally be viewed as a subset optimization problem, albeit one where the corresponding set function does not reflect interactions between candidates. Empirically, this leads to sets often exhibiting high overlap, e.g., strings may differ by only a single word. Yet in use cases that call for multiple solutions, a diverse or representative set is often desired. To address this issue, we propose a reformulation of beam search, which we call determinantal beam search. Determinantal beam search has a natural relationship to determinantal point processes (DPPs), models over sets that inherently encode intra set interactions. By posing iterations in beam search as a series of subdeterminant maximization problems, we can turn the algorithm into a diverse subset selection process. In a case study, we use the string subsequence kernel to explicitly encourage n gram coverage in text generated from a sequence model. We observe that our algorithm offers competitive performance against other diverse set generation strategies in the context of language generation, while providing a more general approach to optimizing for diversity.


Enumerative and Algebraic Combinatorics in the 1960's and 1970's. A partly autobiographical survey of the development of enumerative and algebraic combinatorics in the 1960's and 1970's.


Triggering recollisions with XUV pulses Imprint of recolliding periodic orbits. We consider an electron in an atom driven by an infrared (IR) elliptically polarized laser field after its ionization by an ultrashort extreme ultraviolet (XUV) pulse. We find that, regardless of the atom species and the laser ellipticity, there exists XUV parameters for which the electron returns to its parent ion after ionizing, i.e., undergoes a recollision. This shows that XUV pulses trigger efficiently recollisions in atoms regardless of the ellipticity of the IR field. The XUV parameters for which the electron undergoes a recollision are obtained by studying the location of recolliding periodic orbits (RPOs) in phase space. The RPOs and their linear stability are followed and analyzed as a function of the intensity and ellipticity of the IR field. We determine the relation between the RPOs identified here and the ones found in the literature and used to interpret other types of highly nonlinear phenomena for low elliptically and circularly polarized IR fields.


Enhanced Sensitivity of Degenerate System Made of Two Unstable Resonators Coupled by Gyrator Operating at an Exceptional Point. We demonstrate that a circuit comprising two unstable LC resonators coupled via a gyrator supports an exceptional point of degeneracy (EPD) with purely real eigenfrequency. Each of the two resonators includes either a capacitor or an inductor with a negative value, showing purely imaginary resonance frequency when not coupled to the other via the gyrator. With external perturbation imposed on the system, we show analytically that the resonance frequency response of the circuit follows the square root dependence on perturbation, leading to possible sensor applications. Furthermore, the effect of small losses in the resonators is investigated, and we show that losses lead to instability. In addition, the EPD occurrence and sensitivity are demonstrated by showing that the relevant Puiseux fractional power series expansion describes the eigenfrequency bifurcation near the EPD. The EPD has the great potential to enhance the sensitivity of a sensing system by orders of magnitude. Making use of the EPD in the gyrator based circuit, our results pave the way to realize a new generation of high sensitive sensors to measure small physical or chemical perturbations.


Using scientific machine learning for experimental bifurcation analysis of dynamic systems. Augmenting mechanistic ordinary differential equation (ODE) models with machine learnable structures is an novel approach to create highly accurate, low dimensional models of engineering systems incorporating both expert knowledge and reality through measurement data. Our exploratory study focuses on training universal differential equation (UDE) models for physical nonlinear dynamical systems with limit cycles an aerofoil undergoing flutter oscillations and an electrodynamic nonlinear oscillator. We consider examples where training data is generated by numerical simulations, whereas we also employ the proposed modelling concept to physical experiments allowing us to investigate problems with a wide range of complexity. To collect the training data, the method of control based continuation is used as it captures not just the stable but also the unstable limit cycles of the observed system. This feature makes it possible to extract more information about the observed system than the standard, open loop approach would allow. We use both neural networks and Gaussian processes as universal approximators alongside the mechanistic models to give a critical assessment of the accuracy and robustness of the UDE modelling approach. We also highlight the potential issues one may run into during the training procedure indicating the limits of the current modelling framework.


Large Tate Shafarevich orders from good abc triples. Record values are determined for the order Sha of the Tate Shafarevich group of an elliptic curve E , computed analytically by the Birch Swinnerton Dyer conjecture, and for the Goldfeld Szpiro ratio G Sha sqrt N , where N is the conductor of E . The curves have rank zero and are isogenous to quadratic twists of Frey curves constructed from coprime positive integers (a,b,c) with a b c and c r 1.4 , where the radical r is the product of the primes dividing abc . Curves with Sha 250000 2 and G 12 are found in 20 isogeny classes. Three curves have G 150 . The largest value of Sha is 1937832 2 3.755 times10 12 . This is more than 3.5 times the previous record, which had been computed at a cost about 600 times greater than that for the new record. The primes 25913, 27457, 36929 and 49253 are identified as divisors of Sha values.


Strategic Classification Made Practical. Strategic classification regards the problem of learning in settings where users can strategically modify their features to improve outcomes. This setting applies broadly and has received much recent attention. But despite its practical significance, work in this space has so far been predominantly theoretical. In this paper we present a learning framework for strategic classification that is practical. Our approach directly minimizes the "strategic" empirical risk, achieved by differentiating through the strategic response of users. This provides flexibility that allows us to extend beyond the original problem formulation and towards more realistic learning scenarios. A series of experiments demonstrates the effectiveness of our approach on various learning settings.


Emerging vaccine breakthrough SARS CoV 2 variants. The recent global surge in COVID 19 infections has been fueled by new SARS CoV 2 variants, namely Alpha, Beta, Gamma, Delta, etc. The molecular mechanism underlying such surge is elusive due to 4,653 non degenerate mutations on the spike protein, which is the target of most COVID 19 vaccines. The understanding of the molecular mechanism of transmission and evolution is a prerequisite to foresee the trend of emerging vaccine breakthrough variants and the design of mutation proof vaccines and monoclonal antibodies. We integrate the genotyping of 1,489,884 SARS CoV 2 genomes isolates, 130 human antibodies, tens of thousands of mutational data points, topological data analysis, and deep learning to reveal SARS CoV 2 evolution mechanism and forecast emerging vaccine escape variants. We show that infectivity strengthening and antibody disruptive co mutations on the S protein RBD can quantitatively explain the infectivity and virulence of all prevailing variants. We demonstrate that Lambda is as infectious as Delta but is more vaccine resistant. We analyze emerging vaccine breakthrough co mutations in 20 countries, including the United Kingdom, the United States, Denmark, Brazil, and Germany, etc. We envision that natural selection through infectivity will continue to be the main mechanism for viral evolution among unvaccinated populations, while antibody disruptive co mutations will fuel the future growth of vaccine breakthrough variants among fully vaccinated populations. Finally, we have identified the co mutations that have the great likelihood of becoming dominant A411S, L452R, T478K , L452R, T478K, N501Y , V401L, L452R, T478K , K417N, L452R, T478K , L452R, T478K, E484K, N501Y , and P384L, K417N, E484K, N501Y . We predict they, particularly the last four, will break through existing vaccines. We foresee an urgent need to develop new vaccines that target these co mutations.


EVAGAN Evasion Generative Adversarial Network for Low Data Regimes. A myriad of recent literary works has leveraged generative adversarial networks (GANs) to spawn unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the detection performance of machine learning (ML) classifiers. The quality of generating adversarial samples relies on the adequacy of training data samples. However, in low data regimes like medical diagnostic imaging and cybersecurity, the anomaly samples are scarce in number. This paper proposes a novel GAN design called Evasion Generative Adversarial Network (EVAGAN) that is more suitable for low data regime problems that use oversampling for detection improvement of ML classifiers. EVAGAN not only can generate evasion samples, but its discriminator can act as an evasion aware classifier. We have considered Auxiliary Classifier GAN (ACGAN) as a benchmark to evaluate the performance of EVAGAN on cybersecurity (ISCX 2014, CIC 2017 and CIC2018) botnet and computer vision (MNIST) datasets. We demonstrate that EVAGAN outperforms ACGAN for unbalanced datasets with respect to detection performance, training stability and time complexity. EVAGAN's generator quickly learns to generate the low sample class and hardens its discriminator simultaneously. In contrast to ML classifiers that require security hardening after being adversarially trained by GAN generated data, EVAGAN renders it needless. The experimental analysis proves that EVAGAN is an efficient evasion hardened model for low data regimes for the selected cybersecurity and computer vision datasets. Code will be available at https github.com rhr407 EVAGAN.


Additive energy of cyclic matrix groups and character sums with matrix exponential functions. We obtain a nontrivial bound on the number of solutions to the equation A x 1 A x 2 A x 3 A x 4 , 1 le x 1,x 2,x 3,x 4 le tau , with a fixed n times n matrix A over a finite field mathbb F q of q elements of multiplicative order tau . For n 2 this equation has been considered by Kurlberg and Rudnick (2001) in their study of quantum ergodicity for linear maps over mathbb F q . Furthermore, its multivariate analogue (also with n 2 ) has been studied by Bourgain (2005). We give applications of our result to obtaining a new bound of additive character sums with a matrix exponential function, which is nontrivial beyond the square root threshold, and also to a certain additive problem with matrices. Our results are especially strong for rm SL (n,q) matrices with an irreducible characteristic polynomial.


A new class of MDS symbol pair codes. The symbol pair code is a new coding framework proposed to guard against pair errors in symbol pair read channels. Especially, a symbol pair code with the parameters achieving the Singleton type bound is called an MDS symbol pair code. In this paper, inspiring by the classical construction for Reed Solomon codes, for any 3 le k m le q 2 and m 1 Big lfloor tiny frac m lfloor frac k 1 2 rfloor Big rfloor , we construct a class of q ary MDS symbol pair codes with dimension k and length n (n m m 1, m m 1 1) , where q is a prime power. Furthermore, for k in 3,4 , the symbol pair weight distributions for these codes are determined by enumerating the number of polynomials with given roots.


The spectral property of hypergraph coverings. Let H be connected m uniform hypergraph and mathcal A (H) be the adjacency tensor of H . The stabilizing index s(H) and the cyclic index c(H) of H are respectively the number of eigenvectors of mathcal A (H) associated with the spectral radius and the number of eigenvalues of mathcal A (H) with modulus equal to the spectral radius. In this paper, we investigate the relationship between the above two spectral parameters of H and those of its connected k fold covering bar H . By applying the theory of module and group representation, we prove that s(H) mid s( bar H ) and c(H) mid c( bar H ) . In the situation that bar H is a 2 fold covering of H , if m is even, we show that regardless of multiplicities, the spectrum of mathcal A ( bar H ) contains the spectrum of mathcal A (H) and the spectrum of a signed hypergraph with H as underlying hypergraph if m is odd, we give an explicit formula for s( bar H ) . We also find some differences on the spectral property between hypergraph coverings and graph coverings.


Outlining Traceability A Principle for Operationalizing Accountability in Computing Systems. Accountability is widely understood as a goal for well governed computer systems, and is a sought after value in many governance contexts. But how can it be achieved? Recent work on standards for governable artificial intelligence systems offers a related principle traceability. Traceability requires establishing not only how a system worked but how it was created and for what purpose, in a way that explains why a system has particular dynamics or behaviors. It connects records of how the system was constructed and what the system did mechanically to the broader goals of governance, in a way that highlights human understanding of that mechanical operation and the decision processes underlying it. We examine the various ways in which the principle of traceability has been articulated in AI principles and other policy documents from around the world, distill from these a set of requirements on software systems driven by the principle, and systematize the technologies available to meet those requirements. From our map of requirements to supporting tools, techniques, and procedures, we identify gaps and needs separating what traceability requires from the toolbox available for practitioners. This map reframes existing discussions around accountability and transparency, using the principle of traceability to show how, when, and why transparency can be deployed to serve accountability goals and thereby improve the normative fidelity of systems and their development processes.


Nonwandering sets and special alpha limit sets of monotone maps on regular curves. Let X be a regular curve and let f X to X be a monotone map. In this paper, nonwandering set of f and the structure of special alpha limit sets for f are investigated. We show that AP (f) textrm R (f) Omega(f) , where AP (f) , textrm R (f) and Omega(f) are the sets of almost periodic points, recurrent points and nonwandering of f , respectively. This result extends that of Naghmouchi established, whenever f is a homeomorphism on a regular curve J. Difference Equ. Appl., 23 (2017), 1485 1490 and Colloquium Math., 162 (2020), 263 277 , and that of Abdelli and Abdelli, Abouda and Marzougui, whenever f is a monotone map on a local dendrite Chaos, Solitons Fractals, 71 (2015), 66 72 and Topology Appl., 250 (2018), 61 73 , respectively. On the other hand, we show that for every X setminus textrm P (f) , the special alpha limit set s alpha f (x) is a minimal set, where P (f) is the set of periodic points of f and that s alpha f (x) is always closed, for every x in X . In addition, we prove that textrm SA (f) textrm R (f) , where textrm SA (f) denotes the union of all special alpha limit sets of f these results extend, for monotone case, recent results on interval and graph maps obtained respectively by Hant ' a kov ' a and Roth in Preprint arXiv 2007.10883. and Fory ' s Krawiec, Hant ' a kov ' a and Oprocha in Preprint arXiv 2106.05539. . Further results related to the continuity of the limit maps are also obtained, we prove that the map omega f (resp. alpha f , resp. s alpha f ) is continuous on X setminus textrm P (f) (resp. X infty setminus textrm P (f) ). In particular, it is continuous on X (resp. X infty ) whenever textrm P (f) emptyset .


Curvature of the Second kind and a conjecture of Nishikawa. In this paper, we investigate manifolds for which the curvature of the second kind (following the terminology of Nishikawa) satisfies certain positivity conditions. Our main result settles Nishikawa's conjecture that manifolds for which the curvature (operator) of the second kind are positive are diffeomorphic to a sphere, by showing that such manifolds satisfy Brendle's PIC1 condition. In dimension four we show that curvature of the second kind has a canonical normal form, and use this to classify Einstein four manifolds for which the curvature (operator) of the second kind is five non negative. We also calculate the normal form for some explicit examples in order to show that this assumption is sharp.


NLP CUET DravidianLangTech EACL2021 Offensive Language Detection from Multilingual Code Mixed Text using Transformers. The increasing accessibility of the internet facilitated social media usage and encouraged individuals to express their opinions liberally. Nevertheless, it also creates a place for content polluters to disseminate offensive posts or contents. Most of such offensive posts are written in a cross lingual manner and can easily evade the online surveillance systems. This paper presents an automated system that can identify offensive text from multilingual code mixed data. In the task, datasets provided in three languages including Tamil, Malayalam and Kannada code mixed with English where participants are asked to implement separate models for each language. To accomplish the tasks, we employed two machine learning techniques (LR, SVM), three deep learning (LSTM, LSTM Attention) techniques and three transformers (m BERT, Indic BERT, XLM R) based methods. Results show that XLM R outperforms other techniques in Tamil and Malayalam languages while m BERT achieves the highest score in the Kannada language. The proposed models gained weighted f 1 score of 0.76 (for Tamil), 0.93 (for Malayalam), and 0.71 (for Kannada) with a rank of 3 rd , 5 th and 4 th respectively.


BioCopy A Plug And Play Span Copy Mechanism in Seq2Seq Models. Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of the existing copy mechanisms only consider single word copying from the source sentences, which results in losing essential tokens while copying long spans. In this work, we propose a plug and play architecture, namely BioCopy, to alleviate the problem aforementioned. Specifically, in the training stage, we construct a BIO tag for each token and train the original model with BIO tags jointly. In the inference stage, the model will firstly predict the BIO tag at each time step, then conduct different mask strategies based on the predicted BIO label to diminish the scope of the probability distributions over the vocabulary list. Experimental results on two separate generative tasks show that they all outperform the baseline models by adding our BioCopy to the original model structure.


Accessing HID Devices on the Web With the WebHID API How to play the Chrome Dino Game by Jumping With a Nintendo Joy Con Controller in One's Pocket. In this demonstration, we show how special hardware like Nintendo Joy Con controllers can be made accessible from the Web through the new WebHID API. This novel technology proposal allows developers to write Web drivers in pure JavaScript that talk to Human Interface Device (HID) devices via the HID protocol. One such example of a driver has been realized in the project Joy Con WebHID, which allows for fun pastimes like playing the Google Chrome browser's offline dinosaur game by jumping. This works thanks to the accelerometers built into Joy Con controllers whose signals are read out by the driver and used to control the game character in the browser. A video of the experience is available.


A universal rigid abelian tensor category. We prove that any rigid additive symmetric monoidal category can be mapped to a rigid abelian symmetric monoidal category in a universal way. This yields a novel approach to Grothendieck's standard conjecture D and Voevodsky's smash nilpotence conjecture.


physics.geo-ph cs.LG physics.comp-ph physics.flu-dyn

A Physics Constrained Deep Learning Model for Simulating Multiphase Flow in 3D Heterogeneous Porous Media. In this work, an efficient physics constrained deep learning model is developed for solving multiphase flow in 3D heterogeneous porous media. The model fully leverages the spatial topology predictive capability of convolutional neural networks, and is coupled with an efficient continuity based smoother to predict flow responses that need spatial continuity. Furthermore, the transient regions are penalized to steer the training process such that the model can accurately capture flow in these regions. The model takes inputs including properties of porous media, fluid properties and well controls, and predicts the temporal spatial evolution of the state variables (pressure and saturation). While maintaining the continuity of fluid flow, the 3D spatial domain is decomposed into 2D images for reducing training cost, and the decomposition results in an increased number of training data samples and better training efficiency. Additionally, a surrogate model is separately constructed as a postprocessor to calculate well flow rate based on the predictions of state variables from the deep learning model. We use the example of CO2 injection into saline aquifers, and apply the physics constrained deep learning model that is trained from physics based simulation data and emulates the physics process. The model performs prediction with a speedup of 1400 times compared to physics based simulations, and the average temporal errors of predicted pressure and saturation plumes are 0.27 and 0.099 respectively. Furthermore, water production rate is efficiently predicted by a surrogate model for well flow rate, with a mean error less than 5 . Therefore, with its unique scheme to cope with the fidelity in fluid flow in porous media, the physics constrained deep learning model can become an efficient predictive model for computationally demanding inverse problems or other coupled processes.


Improvement in Machine Translation with Generative Adversarial Networks. In this paper, we explore machine translation improvement via Generative Adversarial Network (GAN) architecture. We take inspiration from RelGAN, a model for text generation, and NMT GAN, an adversarial machine translation model, to implement a model that learns to transform awkward, non fluent English sentences to fluent ones, while only being trained on monolingual corpora. We utilize a parameter lambda to control the amount of deviation from the input sentence, i.e. a trade off between keeping the original tokens and modifying it to be more fluent. Our results improved upon phrase based machine translation in some cases. Especially, GAN with a transformer generator shows some promising results. We suggests some directions for future works to build upon this proof of concept.


Constrained Optimization in the Presence of Noise. The problem of interest is the minimization of a nonlinear function subject to nonlinear equality constraints using a sequential quadratic programming (SQP) method. The minimization must be performed while observing only noisy evaluations of the objective and constraint functions. In order to obtain stability, the classical SQP method is modified by relaxing the standard Armijo line search based on the noise level in the functions, which is assumed to be known. Convergence theory is presented giving conditions under which the iterates converge to a neighborhood of the solution characterized by the noise level and the problem conditioning. The analysis assumes that the SQP algorithm does not require regularization or trust regions. Numerical experiments indicate that the relaxed line search improves the practical performance of the method on problems involving uniformly distributed noise. One important application of this work is in the field of derivative free optimization, when finite differences are employed to estimate gradients.


Extracting Major Topics of COVID 19 Related Tweets. With the outbreak of the Covid 19 virus, the activity of users on Twitter has significantly increased. Some studies have investigated the hot topics of tweets in this period however, little attention has been paid to presenting and analyzing the spatial and temporal trends of Covid 19 topics. In this study, we use the topic modeling method to extract global topics during the nationwide quarantine periods (March 23 to June 23, 2020) on Covid 19 tweets. We implement the Latent Dirichlet Allocation (LDA) algorithm to extract the topics and then name them with the "reopening", "death cases", "telecommuting", "protests", "anger expression", "masking", "medication", "social distance", "second wave", and "peak of the disease" titles. We additionally analyze temporal trends of the topics for the whole world and four countries. By analyzing the graphs, fascinating results are obtained from altering users' focus on topics over time.


The uniform spreading speed in cooperative systems with non uniform initial data. This paper considers the spreading speed of cooperative nonlocal dispersal system with irreducible reaction functions and non uniform initial data. Here the non uniformity means that all components of initial data decay exponentially but their decay rates are different. It is well known that in a monostable reaction diffusion or nonlocal dispersal equation, different decay rates of initial data yield different spreading speeds. In this paper, we show that due to the cooperation and irreducibility of reaction functions, all components of the solution with non uniform initial data will possess a uniform spreading speed which non increasingly depends only on the smallest decay rate of initial data. The nonincreasing property of the uniform spreading speed further implies that the component with the smallest decay rate can accelerate the spatial propagation of other components. In addition, all the methods in this paper can be carried over to the cooperative system with classical diffusion (i.e. random diffusion).


Linear, or Non Linear, That is the Question!. There were fierce debates on whether the non linear embedding propagation of GCNs is appropriate to GCN based recommender systems. It was recently found that the linear embedding propagation shows better accuracy than the non linear embedding propagation. Since this phenomenon was discovered especially in recommender systems, it is required that we carefully analyze the linearity and non linearity issue. In this work, therefore, we revisit the issues of i) which of the linear or non linear propagation is better and ii) which factors of users items decide the linearity non linearity of the embedding propagation. We propose a novel Hybrid Method of Linear and non linEar collaborative filTering method (HMLET, pronounced as Hamlet). In our design, there exist both linear and non linear propagation steps, when processing each user or item node, and our gating module chooses one of them, which results in a hybrid model of the linear and non linear GCN based collaborative filtering (CF). The proposed model yields the best accuracy in three public benchmark datasets. Moreover, we classify users items into the following three classes depending on our gating modules' selections Full Non Linearity (FNL), Partial Non Linearity (PNL), and Full Linearity (FL). We found that there exist strong correlations between nodes' centrality and their class membership, i.e., important user item nodes exhibit more preferences towards the non linearity during the propagation steps. To our knowledge, we are the first who design a hybrid method and report the correlation between the graph centrality and the linearity non linearity of nodes. All HMLET codes and datasets are available at https github.com qbxlvnf11 HMLET.