An End to End Network for Emotion Cause Pair Extraction. The task of Emotion Cause Pair Extraction (ECPE) aims to extract all potential clause pairs of emotions and their corresponding causes in a document. Unlike the more well studied task of Emotion Cause Extraction (ECE), ECPE does not require the emotion clauses to be provided as annotations. Previous works on ECPE have either followed a multi stage approach where emotion extraction, cause extraction, and pairing are done independently or use complex architectures to resolve its limitations. In this paper, we propose an end to end model for the ECPE task. Due to the unavailability of an English language ECPE corpus, we adapt the NTCIR 13 ECE corpus and establish a baseline for the ECPE task on this dataset. On this dataset, the proposed method produces significant performance improvements ( 6.5 increase in F1 score) over the multi stage approach and achieves comparable performance to the state of the art methods.


Graph based Generative Face Anonymisation with Pose Preservation. We propose AnonyGAN, a GAN based solution for face anonymisation which replaces the visual information corresponding to a source identity with a condition identity provided as any single image. With the goal to maintain the geometric attributes of the source face, i.e., the facial pose and expression, and to promote more natural face generation, we propose to exploit a Bipartite Graph to explicitly model the relations between the facial landmarks of the source identity and the ones of the condition identity through a deep model. We further propose a landmark attention model to relax the manual selection of facial landmarks, allowing the network to weight the landmarks for the best visual naturalness and pose preservation. Finally, to facilitate the appearance learning, we propose a hybrid training strategy to address the challenge caused by the lack of direct pixel level supervision. We evaluate our method and its variants on two public datasets, CelebA and LFW, in terms of visual naturalness, facial pose preservation and of its impacts on face detection and re identification. We prove that AnonyGAN significantly outperforms the state of the art methods in terms of visual naturalness, face detection and pose preservation.


Irreducibility criterion for singular hypersurfaces of ( mathbb C n,0) . Using vector fields we obtain an irreducibility criterion for hypersurfaces. It only requires the Weierstrass division.


Eisenstein Metrics. We study families of metrics on automorphic vector bundles associated to representations of the modular group. These metrics are defined using an Eisenstein series construction. We show that in certain cases, the residue of these Eisenstein metrics at their rightmost pole is a harmonic metric for the underlying representation of the modular group. The last section of the paper considers the case of a family of representations that are indecomposable but not irreducible. The analysis of the corresponding Eisenstein metrics, and the location of their rightmost pole, is an open question whose resolution depends on the asymptotics of matrix valued Kloosterman sums.


Auxiliary Learning for Self Supervised Video Representation via Similarity based Knowledge Distillation. Despite the outstanding success of self supervised pretraining methods for video representation learning, they generalise poorly when the unlabeled dataset for pretraining is small or the domain difference between unlabelled data in source task (pretraining) and labeled data in target task (finetuning) is significant. To mitigate these issues, we propose a novel approach to complement self supervised pretraining via an auxiliary pretraining phase, based on knowledge similarity distillation, auxSKD, for better generalisation with a significantly smaller amount of video data, e.g. Kinetics 100 rather than Kinetics 400. Our method deploys a teacher network that iteratively distills its knowledge to the student model by capturing the similarity information between segments of unlabelled video data. The student model meanwhile solves a pretext task by exploiting this prior knowledge. We also introduce a novel pretext task, Video Segment Pace Prediction or VSPP, which requires our model to predict the playback speed of a randomly selected segment of the input video to provide more reliable self supervised representations. Our experimental results show superior results to the state of the art on both UCF101 and HMDB51 datasets when pretraining on K100 in apple to apple comparisons. Additionally, we show that our auxiliary pretraining, auxSKD, when added as an extra pretraining phase to recent state of the art self supervised methods (i.e. VCOP, VideoPace, and RSPNet), improves their results on UCF101 and HMDB51. Our code is available at https github.com Plrbear auxSKD.


Brauer Manin obstruction for zero cycles on certain varieties. We investigate the question of whether the existence of a family of local zero cycles of degree d orthogonal to the Brauer group implies the non emptiness of the Brauer Manin set for certain varieties. We provide various examples of Brauer Manin obstruction to the existence of zero cycles of appropriate degrees.


An averaging result for periodic solutions of Carath ' e odory differential equations. This paper is concerned with the problem of existence of periodic solutions for perturbative Carath ' e odory differential equations. The main result provides sufficient conditions on the averaged equation that guarantee the existence of periodic solutions. Additional conditions are also provided to ensure the uniform convergence of a periodic solution to a constant function. The proof of the main theorem is mainly based on an abstract continuation result for operator equations.


Cofreeness in Real Bordism Theory and the Segal Conjecture. We prove that the genuine C 2 n spectrum N C 2 C 2 n MU mathbb R is cofree, for all n . Our proof is a formal argument using chromatic hypercubes and the Slice Theorem of Hill, Hopkins, and Ravenel. We show that this gives a new proof of the Segal conjecture for C 2 , independent of Lin's theorem.


Analytic exploration of safe basins in a benchmark problem of forced escape. The paper presents an analytical approach for predicting the safe basins (SB) in a plane of initial conditions (IC) for escape of classical particle from the potential well under harmonic forcing. The solution is based on the approximation of isolated resonance, which reduces the dynamics to conservative flow on a two dimensional resonance manifold (RM). Such a reduction allows easy distinction between escaping and non escaping ICs. As a benchmark potential, we choose a common parabolic quartic well with truncation at varying energy levels. The method allows accurate predictions of the SB boundaries for relatively low forcing amplitudes. The derived SBs demonstrate an unexpected set of properties, including decomposition into two disjoint zones in the IC plane for a certain range of parameters. The latter peculiarity stems from two qualitatively different escape mechanisms on the RM. For higher forcing values, the accuracy of the analytic predictions decreases to some extent due to the inaccuracies of the basic isolated resonance approximation, but mainly due to the erosion of the SB boundaries caused by the secondary resonances. Nevertheless, even in this case the analytic approximation can serve as a viable initial guess for subsequent numeric estimation of the SB boundaries.


MGH Metadata Guided Hypergraph Modeling for Unsupervised Person Re identification. As a challenging task, unsupervised person ReID aims to match the same identity with query images which does not require any labeled information. In general, most existing approaches focus on the visual cues only, leaving potentially valuable auxiliary metadata information (e.g., spatio temporal context) unexplored. In the real world, such metadata is normally available alongside captured images, and thus plays an important role in separating several hard ReID matches. With this motivation in mind, we propose textbf MGH , a novel unsupervised person ReID approach that uses meta information to construct a hypergraph for feature learning and label refinement. In principle, the hypergraph is composed of camera topology aware hyperedges, which can model the heterogeneous data correlations across cameras. Taking advantage of label propagation on the hypergraph, the proposed approach is able to effectively refine the ReID results, such as correcting the wrong labels or smoothing the noisy labels. Given the refined results, We further present a memory based listwise loss to directly optimize the average precision in an approximate manner. Extensive experiments on three benchmarks demonstrate the effectiveness of the proposed approach against the state of the art.


Towards Futuristic Autonomous Experimentation A Surprise Reacting Sequential Experiment Policy. An autonomous experimentation platform in manufacturing is supposedly capable of conducting a sequential search for finding suitable manufacturing conditions for advanced materials by itself or even for discovering new materials with minimal human intervention. The core of the intelligent control of such platforms is the policy directing sequential experiments, namely, to decide where to conduct the next experiment based on what has been done thus far. Such policy inevitably trades off exploitation versus exploration and the current practice is under the Bayesian optimization framework using the expected improvement criterion or its variants. We discuss whether it is beneficial to trade off exploitation versus exploration by measuring the element and degree of surprise associated with the immediate past observation. We devise a surprise reacting policy using two existing surprise metrics, known as the Shannon surprise and Bayesian surprise. Our analysis shows that the surprise reacting policy appears to be better suited for quickly characterizing the overall landscape of a response surface or a design place under resource constraints. We argue that such capability is much needed for futuristic autonomous experimentation platforms. We do not claim that we have a fully autonomous experimentation platform, but believe that our current effort sheds new lights or provides a different view angle as researchers are racing to elevate the autonomy of various primitive autonomous experimentation systems.


Dimensionality, Coordination, and Robustness in Voting. We study the performance of voting mechanisms from a utilitarian standpoint, under the recently introduced framework of metric distortion, offering new insights along three main lines. First, if d represents the doubling dimension of the metric space, we show that the distortion of STV is O(d log log m) , where m represents the number of candidates. For doubling metrics this implies an exponential improvement over the lower bound for general metrics, and as a special case it effectively answers a question left open by Skowron and Elkind (AAAI '17) regarding the distortion of STV under low dimensional Euclidean spaces. More broadly, this constitutes the first nexus between the performance of any voting rule and the "intrinsic dimensionality" of the underlying metric space. We also establish a nearly matching lower bound, refining the construction of Skowron and Elkind. Moreover, motivated by the efficiency of STV, we investigate whether natural learning rules can lead to low distortion outcomes. Specifically, we introduce simple, deterministic and decentralized exploration exploitation dynamics, and we show that they converge to a candidate with O(1) distortion. Finally, driven by applications in facility location games, we consider several refinements and extensions of the standard metric setting. Namely, we prove that the deterministic mechanism recently introduced by Gkatzelis, Halpern, and Shah (FOCS '20) attains the optimal distortion bound of 2 under ultra metrics, while it also comes close to our lower bound under distances satisfying approximate triangle inequalities.


Graph and wreath products in topological full groups of full shifts. We prove that the topological full group X of a two sided full shift X Sigma mathbb Z contains every right angled Artin group (also called a graph group). More generally, we show that the family of subgroups with "linear look ahead" is closed under graph products. We show that the lamplighter group mathbb Z 2 wr mathbb Z embeds in X , and conjecture that it does not embed in X with linear look ahead. Generalizing the lamplighter group, we show that whenever G acts with "unique moves" (or at least "move A ithfully"), we have A wr G leq X for finite abelian groups A . We show that free products of finite and cyclic groups act with unique moves. We show that mathbb Z 2 does not admit move A ithful actions, and conjecture that mathbb Z 2 wr mathbb Z 2 does not embed in X at all. We show that topological full groups of all infinite nonwandering sofic shifts have the same subgroups, and that this set of groups is closed under commensurability. The group X embeds in the higher dimensional Thompson group 2 V, so it follows that 2 V contains all RAAGs, refuting a conjecture of Belk, Bleak and Matucci.


On the Chvatal Janson conjecture. In a recent paper, Svante Janson has considered a conjecture suggested by Va v s ek Chv a'atal dealing with the probability that a binomial random variable with parameters n and m n where m is an integer exceeds its expectation m . Albeit Janson has provided a proof of this conjecture for large n , we show that the result actually holds for each n geq 2 .


Active Inference in Robotics and Artificial Agents Survey and Challenges. Active inference is a mathematical framework which originated in computational neuroscience as a theory of how the brain implements action, perception and learning. Recently, it has been shown to be a promising approach to the problems of state estimation and control under uncertainty, as well as a foundation for the construction of goal driven behaviours in robotics and artificial agents in general. Here, we review the state of the art theory and implementations of active inference for state estimation, control, planning and learning describing current achievements with a particular focus on robotics. We showcase relevant experiments that illustrate its potential in terms of adaptation, generalization and robustness. Furthermore, we connect this approach with other frameworks and discuss its expected benefits and challenges a unified framework with functional biological plausibility using variational Bayesian inference.


On the relation between Gegenbauer polynomials and the Ferrers function of the first kind. Using the direct relation between the Gegenbauer polynomials and the Ferrers function of the first kind, we compute interrelations between certain Jacobi polynomials, Meixner polynomials, and the Ferrers function of the first kind. We then compute Rodrigues type and orthogonality relations for Ferrers functions of the first and second kinds. In the remainder of the paper using the relation between Gegenbauer polynomials and the Ferrers function of the first kind we derive connection and linearization relations, some definite integral and series expansions, some asymptotic expansions of Mehler Heine type, Christoffel Darboux summation formulas, and infinite series closure relations (Dirac delta distribution).


Pricing Social Visibility Service in Online Social Networks Modeling and Algorithms. Online social networks (OSNs) such as YoutTube, Instagram, Twitter, Facebook, etc., serve as important platforms for users to share their information or content to friends or followers. Oftentimes, users want to enhance their social visibility, as it can make their contents, i.e., opinions, videos, pictures, etc., attract attention from more users, which in turn may bring higher commercial benefit to them. Motivated by this, we propose a mechanism, where the OSN operator provides a "social visibility boosting service" to incentivize "transactions" between requesters (users who seek to enhance their social visibility via adding new "neighbors") and suppliers (users who are willing to be added as a new "neighbor" of any requester when certain "rewards" is provided). We design a posted pricing scheme for the OSN provider to charge the requesters who use such boosting service, and reward the suppliers who contribute to such boosting service. The OSN operator keeps a fraction of the payment from requesters and distributes the remaining part to participating suppliers "fairly" via the Shapley value. The objective of the OSN provider is to select the price and supplier set to maximize the total amount of revenue under the budget constraint of requesters. We first show that the revenue maximization problem is not simpler than an NP hard problem. We then decomposed it into two sub routines, where one focuses on selecting the optimal set of suppliers, and the other one focuses on selecting the optimal price. We prove the hardness of each sub routine, and eventually design a computationally efficient approximation algorithm to solve the revenue maximization problem with provable theoretical guarantee on the revenue gap. We conduct extensive experiments on four public datasets to validate the superior performance of our proposed algorithms.


On the action of the toggle group of the Dynkin diagram of type A. In this article, we consider involutions, called togglings, on the set of independent sets of the Dynkin diagram of type A, or a path graph. We are interested in the action of the subgroup of the symmetric group of the set of independent sets generated by togglings. We show that the subgroup coincides with the symmetric group.


Exact solutions and bounds for network SIR and SEIR models using a rooted tree approximation. In this paper, we develop a node based approximate model for Markovian contagion dynamics on networks. We prove that our approximate model is exact for SIR (susceptible infectious recovered) and SEIR (susceptible exposed infectious recovered) dynamics on tree graphs with a single source of infection and that the model otherwise gives upper bounds on the probabilities of each node being susceptible. Our analysis of SEIR contagion dynamics is generalised to SEIR models with arbitrarily many distinct classes of exposed state. In the case of trees with a single source of infection, our approach yields a system of partially decoupled linear differential equations that exactly describes the evolution of node state probabilities. We use this to state explicit closed form solutions for SIR dynamics on a chain.


A stacked deep convolutional neural network to predict the remaining useful life of a turbofan engine. This paper presents the data driven techniques and methodologies used to predict the remaining useful life (RUL) of a fleet of aircraft engines that can suffer failures of diverse nature. The solution presented is based on two Deep Convolutional Neural Networks (DCNN) stacked in two levels. The first DCNN is used to extract a low dimensional feature vector using the normalized raw data as input. The second DCNN ingests a list of vectors taken from the former DCNN and estimates the RUL. Model selection was carried out by means of Bayesian optimization using a repeated random subsampling validation approach. The proposed methodology was ranked in the third place of the 2021 PHM Conference Data Challenge.


Comprehensive deep learning model for optical holography. Holography is a vital tool used in various applications from microscopy, solar energy, imaging, display to information encryption. Generation of a holographic image and reconstruction of object hologram information from a holographic image using the current algorithms are time consuming processes. Versatile, fast in the meantime accurate methodologies are required to compute holograms performing color imaging at multiple observation planes and reconstruct object sample information from a holographic image for widely accommodating optical holograms. Here, we focus on design of optical holograms for generation of holographic images at multiple observation planes and colors via a deep learning model the DOENet. The DOENet produces optical holograms which show multitasking performance as multiplexing color holographic image planes by tuning holographic structures. Furthermore, our deep learning model retrieves an object hologram information from an intensity holographic image without requiring phase and amplitude information from the intensity image. We show that reconstructed objects holograms show excellent agreement with the ground truths. The DOENet does not need iteratively reconstruction of object hologram information while conventional object hologram recovery methods rely on multiple holographic images at various observation planes along with the iterative algorithms. We believe that the DOENet based object hologram reconstruction and generation of holographic images may speed up wide area implementation of optical holography.


The role of standing wave in the generation of hot electrons by femtosecond laser beams incident on dense ionized target. We demonstrate the differences in hot electron absorption mechanisms dominant in the interaction of femtosecond laser pulse with intensities 1e18 W cm2 and 1e21 W cm2 on fully ionized target with steep density profile and preplasma with moderate scale length (3 microns). We show that acceleration of each electron starts at the moment when magnetic component of standing electromagnetic wave changes its polarity in regime without preplasma. In the presence of preplasma the stochastic heating is the dominant absorption mechanism along with the longitudinal electric field. It is observed, that wave's energy is absorbed only if standing wave is already created at the position of electron during the interaction with the pulse with intensity 1e18 W cm2. In the case with intensity 1e21 W cm2, part of electrons is pre accelerated in front of the target before the reflection and following stochastic heating. The presence of preplasma results in electron temperatures close to or even exceeding ponderomotive scaling. At higher intensity, the re injection of electrons previously repelled by incident wave's ponderomotive force into high field regions is allowed if standing wave is created.


Internal Wasserstein Distance for Adversarial Attack and Defense. Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks that would trigger misclassification of DNNs but may be imperceptible to human perception. Adversarial defense has been important ways to improve the robustness of DNNs. Existing attack methods often construct adversarial examples relying on some metrics like the ell p distance to perturb samples. However, these metrics can be insufficient to conduct adversarial attacks due to their limited perturbations. In this paper, we propose a new internal Wasserstein distance (IWD) to capture the semantic similarity of two samples, and thus it helps to obtain larger perturbations than currently used metrics such as the ell p distance We then apply the internal Wasserstein distance to perform adversarial attack and defense. In particular, we develop a novel attack method relying on IWD to calculate the similarities between an image and its adversarial examples. In this way, we can generate diverse and semantically similar adversarial examples that are more difficult to defend by existing defense methods. Moreover, we devise a new defense method relying on IWD to learn robust models against unseen adversarial examples. We provide both thorough theoretical and empirical evidence to support our methods.


Type theories in category theory. We introduce basic notions in category theory to type theorists, including comprehension categories, categories with attributes, contextual categories, type categories, and categories with families along with additional discussions that are not very closely related to type theories by listing definitions, lemmata (with detailed, diagram rich proofs), and remarks. By doing so, this introduction becomes more friendly as a referential material to be read in random order (instead of from the beginning to the end). In the end, we list some mistakes made in the early versions of this introduction. The interpretation of common type formers in dependent type theories are discussed based on existing categorical constructions instead of mechanically derived from their type theoretical definition. Non dependent type formers include unit, products (as fiber products), and functions (as fiber exponents), and dependent ones include sigma types, extensional equalities (as equalizers), pi types, and the universe of (all) propositions (as the subobject classifier).


Explainable AI for medical imaging Explaining pneumothorax diagnoses with Bayesian Teaching. Limited expert time is a key bottleneck in medical imaging. Due to advances in image classification, AI can now serve as decision support for medical experts, with the potential for great gains in radiologist productivity and, by extension, public health. However, these gains are contingent on building and maintaining experts' trust in the AI agents. Explainable AI may build such trust by helping medical experts to understand the AI decision processes behind diagnostic judgements. Here we introduce and evaluate explanations based on Bayesian Teaching, a formal account of explanation rooted in the cognitive science of human learning. We find that medical experts exposed to explanations generated by Bayesian Teaching successfully predict the AI's diagnostic decisions and are more likely to certify the AI for cases when the AI is correct than when it is wrong, indicating appropriate trust. These results show that Explainable AI can be used to support human AI collaboration in medical imaging.


Decentralized Policy Information Points for Multi Domain Environments. Access control models have been developed to control authorized access to sensitive resources. This control of access is important as there is now a need for collaborative resource sharing between multiple organizations over open environments like the internet. Although there are multiple access control models that are being widely used, these models are providing access control within a closed environment i.e. within the organization using it. These models have restricted capabilities in providing access control in open environments. Attribute Based Access Control (ABAC) has emerged as a powerful access control model to bring fine grained authorization to organizations that possess sensitive data and resources and want to collaborate over open environments. In an ABAC system, access to resources that an organization possess can be controlled by applying policies on attributes of the users. These policies are conditions that need to be satisfied by the requester in order to gain access to the resource. In this paper, we provide an introduction to ABAC and by carrying forward the architecture of ABAC, we propose a Decentralized Policy Information Point (PIP) model. Our model proposes the decentralization of PIP, which is an entity of the ABAC model that allows the storage and query of user attributes and enforces fine grained access control for controlling the access of sensitive resources over multiple domains. Our model makes use of the concept of a cryptographic primitive called Attribute Based Signature (ABS) to keep the identities of the users involved, private. Our model can be used for collaborative resource sharing over the internet. The evaluation of our model is also discussed to reflect the application of the proposed decentralized PIP model.


Calorie Aware Automatic Meal Kit Generation from an Image. Calorie and nutrition research has attained increased interest in recent years. But, due to the complexity of the problem, literature in this area focuses on a limited subset of ingredients or dish types and simple convolutional neural networks or traditional machine learning. Simultaneously, estimation of ingredient portions can help improve calorie estimation and meal re production from a given image. In this paper, given a single cooking image, a pipeline for calorie estimation and meal re production for different servings of the meal is proposed. The pipeline contains two stages. In the first stage, a set of ingredients associated with the meal in the given image are predicted. In the second stage, given image features and ingredients, portions of the ingredients and finally the total meal calorie are simultaneously estimated using a deep transformer based model. Portion estimation introduced in the model helps improve calorie estimation and is also beneficial for meal re production in different serving sizes. To demonstrate the benefits of the pipeline, the model can be used for meal kits generation. To evaluate the pipeline, the large scale dataset Recipe1M is used. Prior to experiments, the Recipe1M dataset is parsed and explicitly annotated with portions of ingredients. Experiments show that using ingredients and their portions significantly improves calorie estimation. Also, a visual interface is created in which a user can interact with the pipeline to reach accurate calorie estimations and generate a meal kit for cooking purposes.


UniFaceGAN A Unified Framework for Temporally Consistent Facial Video Editing. Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing, previous methods either simply apply transformations frame by frame or utilize multiple frames in a concatenated or iterative fashion, which leads to noticeable visual flickers. In this paper, we propose a unified temporally consistent facial video editing framework termed UniFaceGAN. Based on a 3D reconstruction model and a simple yet efficient dynamic training sample selection mechanism, our framework is designed to handle face swapping and face reenactment simultaneously. To enforce the temporal consistency, a novel 3D temporal loss constraint is introduced based on the barycentric coordinate interpolation. Besides, we propose a region aware conditional normalization layer to replace the traditional AdaIN or SPADE to synthesize more context harmonious results. Compared with the state of the art facial image editing methods, our framework generates video portraits that are more photo realistic and temporally smooth.


Stochastic Image to Video Synthesis using cINNs. Video understanding calls for a model to learn the characteristic interplay between static scene content and its dynamics Given an image, the model must be able to predict a future progression of the portrayed scene and, conversely, a video should be explained in terms of its static image content and all the remaining characteristics not present in the initial frame. This naturally suggests a bijective mapping between the video domain and the static content as well as residual information. In contrast to common stochastic image to video synthesis, such a model does not merely generate arbitrary videos progressing the initial image. Given this image, it rather provides a one to one mapping between the residual vectors and the video with stochastic outcomes when sampling. The approach is naturally implemented using a conditional invertible neural network (cINN) that can explain videos by independently modelling static and other video characteristics, thus laying the basis for controlled video synthesis. Experiments on four diverse video datasets demonstrate the effectiveness of our approach in terms of both the quality and diversity of the synthesized results. Our project page is available at https bit.ly 3t66bnU.


H "older regularity of the nonlinear stochastic time fractional slow and fast diffusion equations on mathbb R d . In this paper, we use local fraction derivative to show the H "older continuity of the solution to the following nonlinear time fractional slow and fast diffusion equation left( partial beta frac nu 2 ( Delta) alpha 2 right)u(t,x) I t gamma left sigma left(u(t,x) right) dot W (t,x) right , quad t 0, x in mathbb R d, where dot W is the space time white noise, alpha in(0,2 , beta in(0,2) , gamma ge 0 and nu 0 , under the condition that 2( beta gamma) 1 d beta alpha 0 . The case when beta gamma le 1 has been obtained in cite ChHuNu19 . In this paper, we have removed this extra condition, which in particular includes all cases for beta in(0,2) .


Modulo periodic Poisson stable solutions of quasilinear differential equations. We introduce a new type of recurrence in the space of continuous and bounded functions. The property is easily verifiable, and can be considered for differential equations. This time, the existence and asymptotic stability of modulo periodic Poisson stable solutions for quasilinear systems are proved. The significant novelty of the research is the numerical simulation of the functions, which is stemmed from dynamical traditions of trigonometric functions, and contributes to applications of Poisson stable oscillations.


Using Jupyter for reproducible scientific workflows. Literate computing has emerged as an important tool for computational studies and open science, with growing folklore of best practices. In this work, we report two case studies one in computational magnetism and another in computational mathematics where domain specific software was exposed to the Jupyter environment. This enables high level control of simulations and computation, interactive exploration of computational results, batch processing on HPC resources, and reproducible workflow documentation in Jupyter notebooks. In the first study, Ubermag drives existing computational micromagnetics software through a domain specific language embedded in Python. In the second study, a dedicated Jupyter kernel interfaces with the GAP system for computational discrete algebra and its dedicated programming language. In light of these case studies, we discuss the benefits of this approach, including progress toward more reproducible and reusable research results and outputs, notably through the use of infrastructure such as JupyterHub and Binder.


Conclusion Stability for Natural Language Based Mining of Design Discussions. Developer discussions range from in person hallway chats to comment chains on bug reports. Being able to identify discussions that touch on software design would be helpful in documentation and refactoring software. Design mining is the application of machine learning techniques to correctly label a given discussion artifact, such as a pull request, as pertaining (or not) to design. In this paper we demonstrate a simple example of how design mining works. We then show how conclusion stability is poor on different artifact types and different projects. We show two techniques augmentation and context specificity that greatly improve the conclusion stability and cross project relevance of design mining. Our new approach achieves AUC of 0.88 on within dataset classification and 0.80 on the cross dataset classification task.


PRA Net Point Relation Aware Network for 3D Point Cloud Analysis. Learning intra region contexts and inter region relations are two effective strategies to strengthen feature representations for point cloud analysis. However, unifying the two strategies for point cloud representation is not fully emphasized in existing methods. To this end, we propose a novel framework named Point Relation Aware Network (PRA Net), which is composed of an Intra region Structure Learning (ISL) module and an Inter region Relation Learning (IRL) module. The ISL module can dynamically integrate the local structural information into the point features, while the IRL module captures inter region relations adaptively and efficiently via a differentiable region partition scheme and a representative point based strategy. Extensive experiments on several 3D benchmarks covering shape classification, keypoint estimation, and part segmentation have verified the effectiveness and the generalization ability of PRA Net. Code will be available at https github.com XiwuChen PRA Net .


5G Multi access Edge Computing Security, Dependability, and Performance. The main innovation of the Fifth Generation (5G) of mobile networks is the ability to provide novel services with new and stricter requirements. One of the technologies that enable the new 5G services is the Multi access Edge Computing (MEC). MEC is a system composed of multiple devices with computing and storage capabilities that are deployed at the edge of the network, i.e., close to the end users. MEC reduces latency and enables contextual information and real time awareness of the local environment. MEC also allows cloud offloading and the reduction of traffic congestion. Performance is not the only requirement that the new 5G services have. New mission critical applications also require high security and dependability. These three aspects (security, dependability, and performance) are rarely addressed together. This survey fills this gap and presents 5G MEC by addressing all these three aspects. First, we overview the background knowledge on MEC by referring to the current standardization efforts. Second, we individually present each aspect by introducing the related taxonomy (important for the not expert on the aspect), the state of the art, and the challenges on 5G MEC. Finally, we discuss the challenges of jointly addressing the three aspects.


Dataset Condensation with Distribution Matching. Computational cost of training state of the art deep models in many learning problems is rapidly increasing due to more sophisticated models and larger datasets. A recent promising direction for reducing training cost is dataset condensation that aims to replace the original large training set with a significantly smaller learned synthetic set while preserving the original information. While training deep models on the small set of condensed images can be extremely fast, their synthesis remains computationally expensive due to the complex bi level optimization and second order derivative computation. In this work, we propose a simple yet effective method that synthesizes condensed images by matching feature distributions of the synthetic and original training images in many sampled embedding spaces. Our method significantly reduces the synthesis cost while achieving comparable or better performance. Thanks to its efficiency, we apply our method to more realistic and larger datasets with sophisticated neural architectures and obtain a significant performance boost. We also show promising practical benefits of our method in continual learning and neural architecture search.


Simultaneously Predicting Multiple Plant Traits from Multiple Sensors via Deformable CNN Regression. Trait measurement is critical for the plant breeding and agricultural production pipeline. Typically, a suite of plant traits is measured using laborious manual measurements and then used to train and or validate higher throughput trait estimation techniques. Here, we introduce a relatively simple convolutional neural network (CNN) model that accepts multiple sensor inputs and predicts multiple continuous trait outputs i.e. a multi input, multi output CNN (MIMO CNN). Further, we introduce deformable convolutional layers into this network architecture (MIMO DCNN) to enable the model to adaptively adjust its receptive field, model complex variable geometric transformations in the data, and fine tune the continuous trait outputs. We examine how the MIMO CNN and MIMO DCNN models perform on a multi input (i.e. RGB and depth images), multi trait output lettuce dataset from the 2021 Autonomous Greenhouse Challenge. Ablation studies were conducted to examine the effect of using single versus multiple inputs, and single versus multiple outputs. The MIMO DCNN model resulted in a normalized mean squared error (NMSE) of 0.068 a substantial improvement over the top 2021 leaderboard score of 0.081. Open source code is provided.


A survey of joint intent detection and slot filling models in natural language understanding. Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks have been deemed to proceed independently. However, more recently, joint models for intent classification and slot filling have achieved state of the art performance, and have proved that there exists a strong relationship between the two tasks. This article is a compilation of past work in natural language understanding, especially joint intent classification and slot filling. We observe three milestones in this research so far Intent detection to identify the speaker's intention, slot filling to label each word token in the speech text, and finally, joint intent classification and slot filling tasks. In this article, we describe trends, approaches, issues, data sets, evaluation metrics in intent classification and slot filling. We also discuss representative performance values, describe shared tasks, and provide pointers to future work, as given in prior works. To interpret the state of the art trends, we provide multiple tables that describe and summarise past research along different dimensions, including the types of features, base approaches, and dataset domain used.


Wind Induced Changes to Shoaling Surface Gravity Wave Shape. Unforced shoaling waves experience growth and changes to wave shape. Similarly, wind forced waves on a flat bottom likewise experience growth decay and changes to wave shape. However, the combined effect of shoaling and wind forcing on wave shape, particularly relevant in the near shore environment, has not yet been investigated theoretically. Here, we consider small amplitude, shallow water solitary waves propagating up a gentle, planar bathymetry forced by a weak, Jeffreys type wind induced surface pressure. We derive a variable coefficient Korteweg de Vries Burgers (vKdV B) equation governing the wave profile's evolution and solve it numerically using a Runge Kutta third order finite difference solver. The simulations run until convective pre breaking a Froude number limit appropriate to the order of the vKdV B equation. Offshore winds weakly enhance the ratio of pre breaking height to depth as well as pre breaking wave slope. Onshore winds have a strong impact on narrowing the wave peak, and wind also modulates the rear shelf formed behind the wave. Furthermore, wind strongly affects the width of the pre breaking zone, with larger effects for smaller beach slopes. After converting our pressure magnitudes to physically realistic wind speeds, we observe qualitative agreement with prior laboratory and numerical experiments on breakpoint location. Additionally, our numerical results have qualitatively similar temporal wave shape to shoaling and wind forced laboratory observations, suggesting that the vKdV B equation captures the essential aspects of wind induced effects on shoaling wave shape. Finally, we isolate the wind's effect by comparing the wave profiles to the unforced case. This reveals that the numerical results are approximately a superposition of a solitary wave, a shoaling induced shelf and a wind induced, bound, dispersive, and decaying tail.


Thermometric Calibration of the Ultrafast Relaxation Dynamics in Plasmonic Au Nanoparticles. The excitation of plasmonic nanoparticles by ultrashort laser pulses sets in motion a complex ultrafast relaxation process involving the gradual re equilibration of the system's electron gas, lattice and environment. One of the major hurdles in studying these processes is the lack of direct measurements of the dynamic temperature evolution of the system subcomponents. We measured the dynamic optical response of ensembles of plasmonic Au nanoparticles following ultrashort pulse excitation and we compared it with the corresponding static optical response as a function of the increasing temperature of the thermodynamic bath. Evaluating the two sets of data, the optical fingerprints of equilibrium or off equilibrium responses could be clearly identified, allowing us to extract a dynamic thermometric calibration scale of the relaxation process, yielding the experimental ultrafast temperature evolution of the plasmonic particles as a function of time.


Cross modal Learning for Domain Adaptation in 3D Semantic Segmentation. Domain adaptation is an important task to enable learning when labels are scarce. While most works focus only on the image modality, there are many important multi modal datasets. In order to leverage multi modality for domain adaptation, we propose cross modal learning, where we enforce consistency between the predictions of two modalities via mutual mimicking. We constrain our network to make correct predictions on labeled data and consistent predictions across modalities on unlabeled target domain data. Experiments in unsupervised and semi supervised domain adaptation settings prove the effectiveness of this novel domain adaptation strategy. Specifically, we evaluate on the task of 3D semantic segmentation using the image and point cloud modality. We leverage recent autonomous driving datasets to produce a wide variety of domain adaptation scenarios including changes in scene layout, lighting, sensor setup and weather, as well as the synthetic to real setup. Our method significantly improves over previous uni modal adaptation baselines on all adaption scenarios. Code will be made available.


Maintaining AUC and H measure over time. Measuring the performance of a classifier is a vital task in machine learning. The running time of an algorithm that computes the measure plays a very small role in an offline setting, for example, when the classifier is being developed by a researcher. However, the running time becomes more crucial if our goal is to monitor the performance of a classifier over time. In this paper we study three algorithms for maintaining two measures. The first algorithm maintains area under the ROC curve (AUC) under addition and deletion of data points in O( log n) time. This is done by maintaining the data points sorted in a self balanced search tree. In addition, we augment the search tree that allows us to query the ROC coordinates of a data point in O( log n) time. In doing so we are able to maintain AUC in O( log n) time. Our next two algorithms involve in maintaining H measure, an alternative measure based on the ROC curve. Computing the measure is a two step process first we need to compute a convex hull of the ROC curve, followed by a sum over the convex hull. We demonstrate that we can maintain the convex hull using a minor modification of the classic convex hull maintenance algorithm. We then show that under certain conditions, we can compute the H measure exactly in O( log 2 n) time, and if the conditions are not met, then we can estimate the H measure in O(( log n epsilon 1 ) log n) time. We show empirically that our methods are significantly faster than the baselines.


A characterization of continuous q Jacobi, Chebyshev of the first kind and Al Salam Chihara polynomials. The purpose of this note is to characterize those orthogonal polynomials sequences (P n) n geq0 for which pi(x) mathcal D q P n(x) (a n x b n)P n(x) c n P n 1 (x), quad n 0,1,2, dots, where mathcal D q is the Askey Wilson operator, pi is a polynomial of degree at most 2, and (a n) n geq0 , (b n) n geq0 and (c n) n geq0 are sequences of complex numbers such that c n neq0 for n 1,2, dots .


Nonlocal diffusion of smooth sets. We consider normal velocity of smooth sets evolving by the s fractional diffusion. We prove that for small time, the normal velocity of such sets is nearly proportional to the mean curvature of the boundary of the initial set for s in frac 1 2 , 1) while, for s in (0, frac 1 2 ) , it is nearly proportional to the fractional mean curvature of the initial set. Our results show that the motion by (fractional) mean curvature flow can be approximated by fractional heat diffusion and by a diffusion by means of harmonic extension of smooth sets.


Towards Vivid and Diverse Image Colorization with Generative Color Prior. Colorization has attracted increasing interest in recent years. Classic reference based methods usually rely on external color images for plausible results. A large image database or online search engine is inevitably required for retrieving such exemplars. Recent deep learning based methods could automatically colorize images at a low cost. However, unsatisfactory artifacts and incoherent colors are always accompanied. In this work, we aim at recovering vivid colors by leveraging the rich and diverse color priors encapsulated in a pretrained Generative Adversarial Networks (GAN). Specifically, we first "retrieve" matched features (similar to exemplars) via a GAN encoder and then incorporate these features into the colorization process with feature modulations. Thanks to the powerful generative color prior and delicate designs, our method could produce vivid colors with a single forward pass. Moreover, it is highly convenient to obtain diverse results by modifying GAN latent codes. Our method also inherits the merit of interpretable controls of GANs and could attain controllable and smooth transitions by walking through GAN latent space. Extensive experiments and user studies demonstrate that our method achieves superior performance than previous works.


The two halves of disjunctive correctness. Ali Enayat had asked whether two halves of Disjunctive Correctness (DC) for the compositional truth predicate are conservative over Peano Arithmetic. In this article, we show that the principle "every true disjunction has a true disjunct" is equivalent to bounded induction for the compositional truth predicate and thus it is not conservative. On the other hand, the converse implication "any disjunction with a true disjunct is true" can be conservatively added to PA. The methods introduced here allow us to give a direct nonconservativeness proof for DC.


MONITOR A Multimodal Fusion Framework to Assess Message Veracity in Social Networks. Users of social networks tend to post and share content with little restraint. Hence, rumors and fake news can quickly spread on a huge scale. This may pose a threat to the credibility of social media and can cause serious consequences in real life. Therefore, the task of rumor detection and verification has become extremely important. Assessing the veracity of a social media message (e.g., by fact checkers) involves analyzing the text of the message, its context and any multimedia attachment. This is a very time consuming task that can be much helped by machine learning. In the literature, most message veracity verification methods only exploit textual contents and metadata. Very few take both textual and visual contents, and more particularly images, into account. In this paper, we second the hypothesis that exploiting all of the components of a social media post enhances the accuracy of veracity detection. To further the state of the art, we first propose using a set of advanced image features that are inspired from the field of image quality assessment, which effectively contributes to rumor detection. These metrics are good indicators for the detection of fake images, even for those generated by advanced techniques like generative adversarial networks (GANs). Then, we introduce the Multimodal fusiON framework to assess message veracIty in social neTwORks (MONITOR), which exploits all message features (i.e., text, social context, and image features) by supervised machine learning. Such algorithms provide interpretability and explainability in the decisions taken, which we believe is particularly important in the context of rumor verification. Experimental results show that MONITOR can detect rumors with an accuracy of 96 and 89 on the MediaEval benchmark and the FakeNewsNet dataset, respectively. These results are significantly better than those of state of the art machine learning baselines.


Robot Localization and Navigation through Predictive Processing using LiDAR. Knowing the position of the robot in the world is crucial for navigation. Nowadays, Bayesian filters, such as Kalman and particle based, are standard approaches in mobile robotics. Recently, end to end learning has allowed for scaling up to high dimensional inputs and improved generalization. However, there are still limitations to providing reliable laser navigation. Here we show a proof of concept of the predictive processing inspired approach to perception applied for localization and navigation using laser sensors, without the need for odometry. We learn the generative model of the laser through self supervised learning and perform both online state estimation and navigation through stochastic gradient descent on the variational free energy bound. We evaluated the algorithm on a mobile robot (TIAGo Base) with a laser sensor (SICK) in Gazebo. Results showed improved state estimation performance when comparing to a state of the art particle filter in the absence of odometry. Furthermore, conversely to standard Bayesian estimation approaches our method also enables the robot to navigate when providing the desired goal by inferring the actions that minimize the prediction error.


GINA Neural Relational Inference From Independent Snapshots. Dynamical systems in which local interactions among agents give rise to complex emerging phenomena are ubiquitous in nature and society. This work explores the problem of inferring the unknown interaction structure (represented as a graph) of such a system from measurements of its constituent agents or individual components (represented as nodes). We consider a setting where the underlying dynamical model is unknown and where different measurements (i.e., snapshots) may be independent (e.g., may stem from different experiments). We propose GINA (Graph Inference Network Architecture), a graph neural network (GNN) to simultaneously learn the latent interaction graph and, conditioned on the interaction graph, the prediction of a node's observable state based on adjacent vertices. GINA is based on the hypothesis that the ground truth interaction graph among all other potential graphs allows to predict the state of a node, given the states of its neighbors, with the highest accuracy. We test this hypothesis and demonstrate GINA's effectiveness on a wide range of interaction graphs and dynamical processes.


The Security Risk of Lacking Compiler Protection in WebAssembly. WebAssembly is increasingly used as the compilation target for cross platform applications. In this paper, we investigate whether one can rely on the security measures enforced by existing C compilers when compiling C programs to WebAssembly. We compiled 4,469 C programs with known buffer overflow vulnerabilities to x86 code and to WebAssembly, and observed the outcome of the execution of the generated code to differ for 1,088 programs. Through manual inspection, we identified that the root cause for these is the lack of security measures such as stack canaries in the generated WebAssembly while x86 code crashes upon a stack based buffer overflow, the corresponding WebAssembly continues to be executed. We conclude that compiling an existing C program to WebAssembly without additional precautions may hamper its security, and we encourage more research in this direction.


Large Scale Hyperspectral Image Clustering Using Contrastive Learning. Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However, their poor scalability, robustness, and generalization ability, mainly resulting from their offline clustering scenarios, greatly limit their application to large scale hyperspectral data. To circumvent these problems, we present a scalable deep online clustering model, named Spectral Spatial Contrastive Clustering (SSCC), based on self supervised learning. Specifically, we exploit a symmetric twin neural network comprised of a projection head with a dimensionality of the cluster number to conduct dual contrastive learning from a spectral spatial augmentation pool. We define the objective function by implicitly encouraging within cluster similarity and reducing between cluster redundancy. The resulting approach is trained in an end to end fashion by batch wise optimization, making it robust in large scale data and resulting in good generalization ability for unseen data. Extensive experiments on three hyperspectral image benchmarks demonstrate the effectiveness of our approach and show that we advance the state of the art approaches by large margins.


Joint AP Association and PCS Threshold Selection in Dense Full duplex Wireless Networks. Joint access point (AP) association and physical carrier sensing (PCS) threshold selection has the potential to improve the performance in high density wireless LANs (WLANs) under high contention, interference and self interference (SI) limited transmissions. Using tools from stochastic geometry, user and AP locations are independent realizations of spatial point processes. Considering the inherent effects of the channel access protocol, the spatial density of throughput (SDT), which depends on channel access probability and coverage rate, is derived as the performance objective. Leveraging spatial statistics of the network, a throughput utility maximization problem is formulated to seek AP association and PCS threshold selection policies that jointly maximize SDT. The AP association and the PCS threshold selection policies are derived analytically while an algorithm is proposed for numerical solution. Under simulated scenarios involving full duplex (FD) nodes, optimizing AP association yields performance gains for low to high node density in large scale wireless networks. Considering PCS threshold selection optimization jointly with AP association is shown to improve performance by effectively separating concurrent transmissions in space. It is shown that AP association in FD WLANs groups users into minimal contention domains and PCS threshold optimization reduces the interference domain of user groups for additional performance gains.


Foreground Action Consistency Network for Weakly Supervised Temporal Action Localization. As a challenging task of high level video understanding, weakly supervised temporal action localization has been attracting increasing attention. With only video annotations, most existing methods seek to handle this task with a localization by classification framework, which generally adopts a selector to select snippets of high probabilities of actions or namely the foreground. Nevertheless, the existing foreground selection strategies have a major limitation of only considering the unilateral relation from foreground to actions, which cannot guarantee the foreground action consistency. In this paper, we present a framework named FAC Net based on the I3D backbone, on which three branches are appended, named class wise foreground classification branch, class agnostic attention branch and multiple instance learning branch. First, our class wise foreground classification branch regularizes the relation between actions and foreground to maximize the foreground background separation. Besides, the class agnostic attention branch and multiple instance learning branch are adopted to regularize the foreground action consistency and help to learn a meaningful foreground classifier. Within each branch, we introduce a hybrid attention mechanism, which calculates multiple attention scores for each snippet, to focus on both discriminative and less discriminative snippets to capture the full action boundaries. Experimental results on THUMOS14 and ActivityNet1.3 demonstrate the state of the art performance of our method. Our code is available at https github.com LeonHLJ FAC Net.


Time dependent Clearance of Cyclosporine in Adult Renal Transplant Recipients A Population Pharmacokinetic Perspective. Aim The pharmacokinetic (PK) properties of cyclosporine (CsA) in renal transplant recipients are patient and time dependent. Knowledge of this time related variability is necessary to maintain or achieve CsA target exposure. Here, we aimed to identify factors explaining variabilities in CsA PK properties and characterise time dependent clearance (CL F) by performing a comprehensive analysis of CsA PK factors using population PK (popPK) modelling of long term follow up data from our institution. Methods In total, 3,674 whole blood CsA concentrations from 183 patients who underwent initial renal transplantation were analysed using nonlinear mixed effects modelling. The effects of potential covariates were selected according to a previous report and well accepted theoretical mechanisms. Model informed individualised therapeutic regimens were also conducted. Results A two compartment model adequately described the data and the estimated mean CsA CL F was 32.6 L h 1 (5 ). Allometrically scaled body size, haematocrit (HCT) level, CGC haplotype carrier status, and postoperative time may contribute to CsA PK variability. The CsA bioavailability in patients receiving a prednisolone dose (PD) of 80 mg was 20.6 lower than that in patients receiving 20 mg. A significant decrease (52.6 ) in CL F was observed as the HCT increased from 10.5 to 60.5 . The CL F of the non CGC haplotype carrier was 14.4 lower than that of the CGC haplotype carrier at 3 months post operation. CsA dose adjustments should be considered in different postoperative periods. Conclusions By monitoring body size, HCT, PD, and CGC haplotype, changes in CsA CL F over time could be predicted. Such information could be used to optimise CsA therapy.


Knowledge driven Description Synthesis for Floor Plan Interpretation. Image captioning is a widely known problem in the area of AI. Caption generation from floor plan images has applications in indoor path planning, real estate, and providing architectural solutions. Several methods have been explored in literature for generating captions or semi structured descriptions from floor plan images. Since only the caption is insufficient to capture fine grained details, researchers also proposed descriptive paragraphs from images. However, these descriptions have a rigid structure and lack flexibility, making it difficult to use them in real time scenarios. This paper offers two models, Description Synthesis from Image Cue (DSIC) and Transformer Based Description Generation (TBDG), for the floor plan image to text generation to fill the gaps in existing methods. These two models take advantage of modern deep neural networks for visual feature extraction and text generation. The difference between both models is in the way they take input from the floor plan image. The DSIC model takes only visual features automatically extracted by a deep neural network, while the TBDG model learns textual captions extracted from input floor plan images with paragraphs. The specific keywords generated in TBDG and understanding them with paragraphs make it more robust in a general floor plan image. Experiments were carried out on a large scale publicly available dataset and compared with state of the art techniques to show the proposed model's superiority.


Multi Domain Few Shot Learning and Dataset for Agricultural Applications. Automatic classification of pests and plants (both healthy and diseased) is of paramount importance in agriculture to improve yield. Conventional deep learning models based on convolutional neural networks require thousands of labeled examples per category. In this work we propose a method to learn from a few samples to automatically classify different pests, plants, and their diseases, using Few Shot Learning (FSL). We learn a feature extractor to generate embeddings and then update the embeddings using Transformers. Using Mahalanobis distance, a class covariance based metric, we then calculate the similarity of the transformed embeddings with the embedding of the image to be classified. Using our proposed architecture, we conduct extensive experiments on multiple datasets showing the effectiveness of our proposed model. We conduct 42 experiments in total to comprehensively analyze the model and it achieves up to 14 and 24 performance gains on few shot image classification benchmarks on two datasets. We also compile a new FSL dataset containing images of healthy and diseased plants taken in real world settings. Using our proposed architecture which has been shown to outperform several existing FSL architectures in agriculture, we provide strong baselines on our newly proposed dataset.


Forward Backward Splitting with Deviations for Monotone Inclusions. We propose and study a weakly convergent variant of the forward backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per iteration deviation vector which provides additional degrees of freedom. The only requirement on the deviation vector to guarantee convergence is that its norm is bounded by a quantity that can be computed online. This approach provides great flexibility and opens up for the design of new and improved forward backward based algorithms, while retaining global convergence guarantees. These guarantees include linear convergence of our method under a metric subregularity assumption without the need to adapt the algorithm parameters. Choosing suitable monotone operators allows for incorporating deviations into other algorithms, such as Chambolle Pock and Krasnoselsky Mann iterations. We propose a novel inertial Chambolle Pock algorithm by selecting the deviations along a momentum direction and deciding their size using the norm condition. Numerical experiments demonstrate our convergence claims and show that even this simple choice of deviation vector can improve the performance, compared, e.g., to the standard Chambolle Pock algorithm.


General Board Geometry. Game boards are described in the Ludii general game system by their underlying graphs, based on tiling, shape and graph operators, with the automatic detection of important properties such as topological relationships between graph elements, directions and radial step sequences. This approach allows most conceivable game boards to be described simply and succinctly.


Variance Penalized On Policy and Off Policy Actor Critic. Reinforcement learning algorithms are typically geared towards optimizing the expected return of an agent. However, in many practical applications, low variance in the return is desired to ensure the reliability of an algorithm. In this paper, we propose on policy and off policy actor critic algorithms that optimize a performance criterion involving both mean and variance in the return. Previous work uses the second moment of return to estimate the variance indirectly. Instead, we use a much simpler recently proposed direct variance estimator which updates the estimates incrementally using temporal difference methods. Using the variance penalized criterion, we guarantee the convergence of our algorithm to locally optimal policies for finite state action Markov decision processes. We demonstrate the utility of our algorithm in tabular and continuous MuJoCo domains. Our approach not only performs on par with actor critic and prior variance penalization baselines in terms of expected return, but also generates trajectories which have lower variance in the return.


Explaining Network Intrusion Detection System Using Explainable AI Framework. Cybersecurity is a domain where the data distribution is constantly changing with attackers exploring newer patterns to attack cyber infrastructure. Intrusion detection system is one of the important layers in cyber safety in today's world. Machine learning based network intrusion detection systems started showing effective results in recent years. With deep learning models, detection rates of network intrusion detection system are improved. More accurate the model, more the complexity and hence less the interpretability. Deep neural networks are complex and hard to interpret which makes difficult to use them in production as reasons behind their decisions are unknown. In this paper, we have used deep neural network for network intrusion detection and also proposed explainable AI framework to add transparency at every stage of machine learning pipeline. This is done by leveraging Explainable AI algorithms which focus on making ML models less of black boxes by providing explanations as to why a prediction is made. Explanations give us measurable factors as to what features influence the prediction of a cyberattack and to what degree. These explanations are generated from SHAP, LIME, Contrastive Explanations Method, ProtoDash and Boolean Decision Rules via Column Generation. We apply these approaches to NSL KDD dataset for intrusion detection system and demonstrate results.


Machines Influence An Information Systems Lens. Policymakers face a broader challenge of how to view AI capabilities today and where does society stand in terms of those capabilities. This paper surveys AI capabilities and tackles this very issue, exploring it in context of political security in digitally networked societies. We extend the ideas of Information Management to better understand contemporary AI systems as part of a larger and more complex information system. Comprehensively reviewing AI capabilities and contemporary man machine interactions, we undertake conceptual development to suggest that better information management could allow states to more optimally offset the risks of AI enabled influence and better utilise the emerging capabilities which these systems have to offer to policymakers and political institutions across the world. Hopefully this long essay will actuate further debates and discussions over these ideas, and prove to be a useful contribution towards governing the future of AI.


Making Differentiable Architecture Search less local. Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency. However, it has been shown to suffer from performance collapse, where the search often leads to detrimental architectures. Many recent works try to address this issue of DARTS by identifying indicators for early stopping, regularising the search objective to reduce the dominance of some operations, or changing the parameterisation of the search problem. In this work, we hypothesise that performance collapses can arise from poor local optima around typical initial architectures and weights. We address this issue by developing a more global optimisation scheme that is able to better explore the space without changing the DARTS problem formulation. Our experiments show that our changes in the search algorithm allow the discovery of architectures with both better test performance and fewer parameters.


PoseFace Pose Invariant Features and Pose Adaptive Loss for Face Recognition. Despite the great success achieved by deep learning methods in face recognition, severe performance drops are observed for large pose variations in unconstrained environments (e.g., in cases of surveillance and photo tagging). To address it, current methods either deploy pose specific models or frontalize faces by additional modules. Still, they ignore the fact that identity information should be consistent across poses and are not realizing the data imbalance between frontal and profile face images during training. In this paper, we propose an efficient PoseFace framework which utilizes the facial landmarks to disentangle the pose invariant features and exploits a pose adaptive loss to handle the imbalance issue adaptively. Extensive experimental results on the benchmarks of Multi PIE, CFP, CPLFW and IJB have demonstrated the superiority of our method over the state of the arts.


Effective Mathematical Modelling of Health Passes during a Pandemic. We study the impact on the epidemiological dynamics of a class of restrictive measures that are aimed at reducing the number of contacts of individuals who have a higher risk of being infected with a transmittable disease. Such measures are currently either implemented or at least discussed in numerous countries worldwide to ward off a potential new wave of COVID 19 across Europe. They come in the form of Health Passes (HP), which grant full access to public life only to individuals with a certificate that proves that they have either been fully vaccinated, have recovered from a previous infection or have recently tested negative to SARS Cov 19 . We develop both a compartmental model as well as an epidemic Renormalisation Group approach, which is capable of describing the dynamics over a longer period of time, notably an entire epidemiological wave. Introducing different versions of HPs in this model, we are capable of providing quantitative estimates on the effectiveness of the underlying measures as a function of the fraction of the population that is vaccinated and the vaccination rate. We apply our models to the latest COVID 19 wave in several European countries, notably Germany and Austria, which validate our theoretical findings.


Power law Portfolios. Portfolio optimization methods suffer from a catalogue of known problems, mainly due to the facts that pair correlations of asset returns are unstable, and that extremal risk measures such as maximum drawdown are difficult to predict due to the non Gaussianity of portfolio returns. In order to look at optimal portfolios for arbitrary risk penalty functions, we construct portfolio shapes where the penalty is proportional to a moment of the returns of arbitrary order p 2 . The resulting component weight in the portfolio scales sub linearly with its return, with the power law w propto mu 1 (p 1) . This leads to significantly improved diversification when compared to Kelly portfolios, due to the dilution of the winner takes all effect. In the limit of penalty order p rightarrow infty , we recover the simple trading heuristic whereby assets are allocated a fixed positive weight when their return exceeds the hurdle rate, and zero otherwise. Infinite order power law portfolios thus fall into the class of perfectly diversified portfolios.


How Heavy Is It? Humanoid Robot Estimating Physical Properties of Unknown Objects Without Force Torque Sensors. Many robots utilize commercial force torque sensors to identify physical properties of a priori unknown objects. However, such sensors can be difficult to apply to smaller sized robots due to their weight, size, and high cost. In this paper, we propose a framework for smaller sized humanoid robots to estimate the inertial properties of unknown objects without using force torque sensors. In our framework, a neural network is designed and trained to predict joint torque outputs. The neural network's inputs are robot's joint angle, steady state joint error, and motor current. All of these can be easily obtained from many existing smaller sized robots. As the joint rotation direction is taken into account, the neural network can be trained with a smaller sample size, but still maintains accurate torque estimation capability. Eventually, the inertial properties of the objects are identified using a nonlinear optimization method. Our proposed framework has been demonstrated on a NAO humanoid robot.


Curiosity based Robot Navigation under Uncertainty in Crowded Environments. Mobile robots have become more and more popular in our daily life. In large scale and crowded environments, how to navigate safely with localization precision is a critical problem. To solve this problem, we proposed a curiosity based framework that can find an effective path with the consideration of human comfort, localization uncertainty, crowds, and the cost to go to the target. Three parts are involved in the proposed framework the distance assessment module, the curiosity gain of the information rich area, and the curiosity negative gain of crowded areas. The curiosity gain of the information rich area was proposed to provoke the robot to approach localization referenced landmarks. To guarantee human comfort while coexisting with robots, we propose curiosity gain of the spacious area to bypass the crowd and maintain an appropriate distance between robots and humans. The evaluation is conducted in an unstructured environment. The results show that our method can find a feasible path, which can consider the localization uncertainty while simultaneously avoiding the crowded area. Curiosity based Robot Navigation under Uncertainty in Crowded Environments


RECAST Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization. With the widespread use of toxic language online, platforms are increasingly using automated systems that leverage advances in natural language processing to automatically flag and remove toxic comments. However, most automated systems when detecting and moderating toxic language do not provide feedback to their users, let alone provide an avenue of recourse for these users to make actionable changes. We present our work, RECAST, an interactive, open sourced web tool for visualizing these models' toxic predictions, while providing alternative suggestions for flagged toxic language. Our work also provides users with a new path of recourse when using these automated moderation tools. RECAST highlights text responsible for classifying toxicity, and allows users to interactively substitute potentially toxic phrases with neutral alternatives. We examined the effect of RECAST via two large scale user evaluations, and found that RECAST was highly effective at helping users reduce toxicity as detected through the model. Users also gained a stronger understanding of the underlying toxicity criterion used by black box models, enabling transparency and recourse. In addition, we found that when users focus on optimizing language for these models instead of their own judgement (which is the implied incentive and goal of deploying automated models), these models cease to be effective classifiers of toxicity compared to human annotations. This opens a discussion for how toxicity detection models work and should work, and their effect on the future of online discourse.


A Comprehensive Study on Various Statistical Techniques for Prediction of Movie Success. The film industry is one of the most popular entertainment industries and one of the biggest markets for business. Among the contributing factors to this would be the success of a movie in terms of its popularity as well as its box office performance. Hence, we create a comprehensive comparison between the various machine learning models to predict the rate of success of a movie. The effectiveness of these models along with their statistical significance is studied to conclude which of these models is the best predictor. Some insights regarding factors that affect the success of the movies are also found. The models studied include some Regression models, Machine Learning models, a Time Series model and a Neural Network with the Neural Network being the best performing model with an accuracy of about 86 . Additionally, as part of the testing data for the movies released in 2020 are analysed.


The enhanced derived vector space approach to domain decomposition methods. Standard approaches to domain decomposition methods (DDM) are uncapable of producing block diagonal system matrices. The derived vector space (DVS), approach to DDM, introduced in 2013, overcomes this limitation. However, the DVS approach in its original form was applicable to a relatively narrow class of problems because it required building a special matrix, whose construction is frequently impossible. In this paper, an enhanced formulation of DVS is presented, which does not require the construction of a special matrix and is applicable to any linear problem. Keywords domain decomposition, parallel processing, DVS, FETI, BDDC


Event Based Feature Tracking in Continuous Time with Sliding Window Optimization. We propose a novel method for continuous time feature tracking in event cameras. To this end, we track features by aligning events along an estimated trajectory in space time such that the projection on the image plane results in maximally sharp event patch images. The trajectory is parameterized by n th order B splines, which are continuous up to (n 2) th derivative. In contrast to previous work, we optimize the curve parameters in a sliding window fashion. On a public dataset we experimentally confirm that the proposed sliding window B spline optimization leads to longer and more accurate feature tracks than in previous work.


Multi VFL A Vertical Federated Learning System for Multiple Data and Label Owners. Vertical Federated Learning (VFL) refers to the collaborative training of a model on a dataset where the features of the dataset are split among multiple data owners, while label information is owned by a single data owner. In this paper, we propose a novel method, Multi Vertical Federated Learning (Multi VFL), to train VFL models when there are multiple data and label owners. Our approach is the first to consider the setting where D data owners (across which features are distributed) and K label owners (across which labels are distributed) exist. This proposed configuration allows different entities to train and learn optimal models without having to share their data. Our framework makes use of split learning and adaptive federated optimizers to solve this problem. For empirical evaluation, we run experiments on the MNIST and FashionMNIST datasets. Our results show that using adaptive optimizers for model aggregation fastens convergence and improves accuracy.


Uniform regularity for the compressible Navier Stokes system with low Mach number in bounded domains. We establish uniform with respect to the Mach number regularity estimates for the isentropic compressible Navier Stokes system in smooth domains with Navier slip condition on the boundary in the general case of ill prepared initial data. To match the boundary layer effects due to the fast oscillations and the ill prepared initial data assumption, we prove uniform estimates in an anisotropic functional framework with only one normal derivative close to the boundary. This allows to prove the local existence of a strong solution on a time interval independent of the Mach number and to justify the incompressible limit through a simple compactness argument.


Average Reward Learning and Planning with Options. We extend the options framework for temporal abstraction in reinforcement learning from discounted Markov decision processes (MDPs) to average reward MDPs. Our contributions include general convergent off policy inter option learning algorithms, intra option algorithms for learning values and models, as well as sample based planning variants of our learning algorithms. Our algorithms and convergence proofs extend those recently developed by Wan, Naik, and Sutton. We also extend the notion of option interrupting behavior from the discounted to the average reward formulation. We show the efficacy of the proposed algorithms with experiments on a continuing version of the Four Room domain.


Recent Advances in Fully Dynamic Graph Algorithms. In recent years, significant advances have been made in the design and analysis of fully dynamic algorithms. However, these theoretical results have received very little attention from the practical perspective. Few of the algorithms are implemented and tested on real datasets, and their practical potential is far from understood. Here, we present a quick reference guide to recent engineering and theory results in the area of fully dynamic graph algorithms.


Layered Controllable Video Generation. We introduce layered controllable video generation, where we, without any supervision, decompose the initial frame of a video into foreground and background layers, with which the user can control the video generation process by simply manipulating the foreground mask. The key challenges are the unsupervised foreground background separation, which is ambiguous, and ability to anticipate user manipulations with access to only raw video sequences. We address these challenges by proposing a two stage learning procedure. In the first stage, with the rich set of losses and dynamic foreground size prior, we learn how to separate the frame into foreground and background layers and, conditioned on these layers, how to generate the next frame using VQ VAE generator. In the second stage, we fine tune this network to anticipate edits to the mask, by fitting (parameterized) control to the mask from future frame. We demonstrate the effectiveness of this learning and the more granular control mechanism, while illustrating state of the art performance on two benchmark datasets. We provide a video abstract as well as some video results on https gabriel huang.github.io layered controllable video generation


Video Relation Detection with Trajectory aware Multi modal Features. Video relation detection problem refers to the detection of the relationship between different objects in videos, such as spatial relationship and action relationship. In this paper, we present video relation detection with trajectory aware multi modal features to solve this task. Considering the complexity of doing visual relation detection in videos, we decompose this task into three sub tasks object detection, trajectory proposal and relation prediction. We use the state of the art object detection method to ensure the accuracy of object trajectory detection and multi modal feature representation to help the prediction of relation between objects. Our method won the first place on the video relation detection task of Video Relation Understanding Grand Challenge in ACM Multimedia 2020 with 11.74 mAP, which surpasses other methods by a large margin.


Advancing Data for Street level Flood Vulnerability Extraction of Variables from Google Street View in Quito, Ecuador. Data relevant to flood vulnerability is minimal and infrequently collected, if at all, for much of the world. This makes it difficult to highlight areas for humanitarian aid, monitor changes, and support communities in need. It would be time consuming and resource intensive to do an exhaustive study for multiple flood relevant vulnerability variables using a field survey. We use a mixed methods approach to develop a survey on variables of interest and utilize an open source crowdsourcing technique to remotely collect data with a human machine interface using high resolution satellite images and Google Street View. This paper focuses on Quito, Ecuador as a case study, but the methodology can be quickly replicated to produce labelled training data in other areas. The overall project goal is to build training datasets that in the future will allow us to automate the mapping of flood vulnerability for urban areas in geographic regions.


Network Growth From Global and Local Influential Nodes. In graph theory and network analysis, node degree is defined as a simple but powerful centrality to measure the local influence of node in a complex network. Preferential attachment based on node degree has been widely adopted for modeling network growth. However, many evidences exist which show deviation of real network growth from what a pure degree based model suggests. It seems that node degree is not a reliable measure for predicting the preference of newcomers in attaching to the network, or at least, it does not tell the whole story. In this paper, we argue that there is another dimension to network growth, one that we call node "coreness". The new dimension gives insights on the global influence of nodes, in comparison to the local view the degree metric provides. We found that the probability of existing nodes attracting new nodes generally follows an exponential dependence on node coreness, while at the same time, follows a power law dependence on node degree. That is to say, high coreness nodes are more powerful than high degree nodes in attracting newcomers. The new dimension further discloses some hidden phenomena which happen in the process of network growth. The power of node degree in attracting newcomers increases over time while the influence of coreness decreases, and finally, they reach a state of equilibrium in the growth. All these theories have been tested on real world networks.


On the complexity of structure and substructure connectivity of graphs. The connectivity of a graph is an important parameter to measure its reliability. Structure and substructure connectivity are two novel generalizations of the connectivity. In this paper, we characterize the complexity of determining structure and substructure connectivity of graphs, showing that they are both NP complete.


Mean Field Games with Common Noises and Conditional Distribution Dependent FBSDEs. In this paper, we consider the mean field game with a common noise and allow the state coefficients to vary with the conditional distribution in a nonlinear way. We assume that the cost function satisfies a convexity and a weak monotonicity property. We use the sufficient Pontryagin principle for optimality to transform the mean field control problem into existence and uniqueness of solution of conditional distribution dependent forward backward stochastic differential equation (FBSDE). We prove the existence and uniqueness of solution of the conditional distribution dependent FBSDE when the dependence of the state on the conditional distribution is sufficiently small, or when the convexity parameter of the running cost on the control is sufficiently large. Two different methods are developed. The first method is based on a continuation of the coefficients, which is developed for FBSDE by Hu and Peng cite YH2 . We apply the method to conditional distribution dependent FBSDE. The second method is to show the existence result on a small time interval by Banach fixed point theorem and then extend the local solution to the whole time interval.


Predicting the Binding of SARS CoV 2 Peptides to the Major Histocompatibility Complex with Recurrent Neural Networks. Predicting the binding of viral peptides to the major histocompatibility complex with machine learning can potentially extend the computational immunology toolkit for vaccine development, and serve as a key component in the fight against a pandemic. In this work, we adapt and extend USMPep, a recently proposed, conceptually simple prediction algorithm based on recurrent neural networks. Most notably, we combine regressors (binding affinity data) and classifiers (mass spectrometry data) from qualitatively different data sources to obtain a more comprehensive prediction tool. We evaluate the performance on a recently released SARS CoV 2 dataset with binding stability measurements. USMPep not only sets new benchmarks on selected single alleles, but consistently turns out to be among the best performing methods or, for some metrics, to be even the overall best performing method for this task.


On the smallest area n 1 gon containing a convex n gon. We prove that every unit area convex pentagon is contained in a convex quadrilateral of area no greater than 3 sqrt 5 , and that every unit area convex hexagon is contained in a convex pentagon of area no greater than 7 6 . Both results are tight as the case of the regular pentagon (hexagon) shows. We conjecture that for every n ge 6 , every unit area convex n gon is contained in a (n 1) gon of area no greater than 1 tan(2 pi n) sec( pi n) n .


On computable aspects of algebraic and definable closure. We investigate the computability of algebraic closure and definable closure with respect to a collection of formulas. We show that for a computable collection of formulas of quantifier rank at most n , in any given computable structure, both algebraic and definable closure with respect to that collection are Sigma 0 n 2 sets. We further show that these bounds are tight.


KnowGraph IITK at SemEval 2021 Task 11 Building KnowledgeGraph for NLP Research. Research in Natural Language Processing is making rapid advances, resulting in the publication of a large number of research papers. Finding relevant research papers and their contribution to the domain is a challenging problem. In this paper, we address this challenge via the SemEval 2021 Task 11 NLPContributionGraph, by developing a system for a research paper contributions focused knowledge graph over Natural Language Processing literature. The task is divided into three sub tasks extracting contribution sentences that show important contributions in the research article, extracting phrases from the contribution sentences, and predicting the information units in the research article together with triplet formation from the phrases. The proposed system is agnostic to the subject domain and can be applied for building a knowledge graph for any area. We found that transformer based language models can significantly improve existing techniques and utilized the SciBERT based model. Our first sub task uses Bidirectional LSTM (BiLSTM) stacked on top of SciBERT model layers, while the second sub task uses Conditional Random Field (CRF) on top of SciBERT with BiLSTM. The third sub task uses a combined SciBERT based neural approach with heuristics for information unit prediction and triplet formation from the phrases. Our system achieved F1 score of 0.38, 0.63 and 0.76 in end to end pipeline testing, phrase extraction testing and triplet extraction testing respectively.


IRLI Iterative Re partitioning for Learning to Index. Neural models have transformed the fundamental information retrieval problem of mapping a query to a giant set of items. However, the need for efficient and low latency inference forces the community to reconsider efficient approximate near neighbor search in the item space. To this end, learning to index is gaining much interest in recent times. Methods have to trade between obtaining high accuracy while maintaining load balance and scalability in distributed settings. We propose a novel approach called IRLI (pronounced early'), which iteratively partitions the items by learning the relevant buckets directly from the query item relevance data. Furthermore, IRLI employs a superior power of k choices based load balancing strategy. We mathematically show that IRLI retrieves the correct item with high probability under very natural assumptions and provides superior load balancing. IRLI surpasses the best baseline's precision on multi label classification while being 5x faster on inference. For near neighbor search tasks, the same method outperforms the state of the art Learned Hashing approach NeuralLSH by requiring only 1 6 th of the candidates for the same recall. IRLI is both data and model parallel, making it ideal for distributed GPU implementation. We demonstrate this advantage by indexing 100 million dense vectors and surpassing the popular FAISS library by 10 on recall.


Transparent Model of Unabridged Data (TMUD). Recent advancements in computational power and algorithms have enabled unabridged data (e.g., raw images or audio) to be used as input in some models (e.g., deep learning). However, the black box nature of such models reduces their likelihood of adoption by marketing scholars. Our paradigm of analysis, the Transparent Model of Unabridged Data (TMUD), enables researchers to investigate the inner workings of such black box models by incorporating an ex ante filtration module and an ex post experimentation module. We empirically demonstrate the TMUD by investigating the role of facial components and sexual dimorphism in face perceptions, which have implications for four marketing contexts advertisement (perceptions of approachability, trustworthiness, and competence), brand (perceptions of whether a face represents a brand's typical customer), category (perceptions of whether a face represents a category's typical customer), and customer persona (perceptions of whether a face represents the persona of a brand's customer segment). Our results reveal new and useful findings that enrich the existing literature on face perception, most of which is based on abridged attributes (e.g., width of mouth). The TMUD has great potential to be a useful paradigm for generating theoretical insights and may encourage more marketing researchers and practitioners to use unabridged data.


EVReflex Dense Time to Impact Prediction for Event based Obstacle Avoidance. The broad scope of obstacle avoidance has led to many kinds of computer vision based approaches. Despite its popularity, it is not a solved problem. Traditional computer vision techniques using cameras and depth sensors often focus on static scenes, or rely on priors about the obstacles. Recent developments in bio inspired sensors present event cameras as a compelling choice for dynamic scenes. Although these sensors have many advantages over their frame based counterparts, such as high dynamic range and temporal resolution, event based perception has largely remained in 2D. This often leads to solutions reliant on heuristics and specific to a particular task. We show that the fusion of events and depth overcomes the failure cases of each individual modality when performing obstacle avoidance. Our proposed approach unifies event camera and lidar streams to estimate metric time to impact without prior knowledge of the scene geometry or obstacles. In addition, we release an extensive event based dataset with six visual streams spanning over 700 scanned scenes.