DiSH trend Intervention Modeling Simulator That Accounts for Trend Influences. Simulation on directed graphs is an important method for understanding the dynamics in the systems where connectivity graphs contain cycles. Discrete Stochastic Heterogeneous Simulator (DiSH) is one of the simulation tools with wide application, which uses regulator values to calculate state updates of regulated elements. Here we present a new simulation approach DiSH trend which also takes into account the trends in regulating elements. We demonstrate the features of trend based regulation, as well as hybrid regulation, which is a combination of the trend and level based approaches. The modeling capabilities are demonstrated on a small toy model, showcasing different functionalities. Real world capabilities are demonstrated on a larger network model of food insecurity in the Ethiopian region Oromia. Adding trend based regulation to models results in increased modeling flexibility, and hybrid regulation improves qualitative dynamic behavior prediction. With appropriate data, DiSH trend becomes a powerful tool for exploring intervention strategies.


Hodge classes of type (2, 2) on Hilbert squares of projective K3 surfaces. We give a basis for the vector space generated by rational Hodge classes of type (2,2) on the Hilbert square of a projective K3 surface general in its rank, which is a subspace of the singular cohomology ring with rational coefficients we use Nakajima operators and an algebraic model developed by Lehn and Sorger as main tools. We then obtain a basis of the lattice generated by integral Hodge classes of type (2,2) on the Hilbert square of a projective K3 surface general in its rank we exploit lattice theory, a theorem by Qin and Wang and a result by Ellingsrud, G "ottsche and Lehn.


Harmless Sets in Sparse Classes. In the classic TARGET SAT SELECTION problem, we are asked to minimise the number of nodes to activate so that, after the application of a certain propagation process, all nodes of the graph are active. Bazgan and Chopin Discrete Optimization , 14 170 182, 2014 introduced the opposite problem, named HARMLESS SET, in which they ask to maximise the number of nodes to activate such that not a single additional node is activated. In this paper we investigate how sparsity impacts the tractability of HARMLESS SET. Specifically, we answer two open questions posed by the aforementioned authors, namely a) whether the problem is FPT on planar graphs and b) whether it is FPT parametrised by treewidth. The first question can be answered in the positive using existing meta theorems on sparse classes, and we further show that HARMLESS SET not only admits a polynomial kernel, but that it can be solved in subexponential time. We then answer the second question in the negative by showing that the problem is W 1 hard when parametrised by a parameter that upper bounds treewidth.


A two track tour of Cauchy's Cours. Cauchy published his Cours d'Analyse 200 years ago. We analyze Cauchy's take on the concepts of rigor, continuity, and limit, and explore a pair of approaches in the literature to the meaning of his infinitesimal analysis and his sum theorem on the convergence of series of continuous functions.


Widely tunable and narrow linewidth chip scale lasers from deep visible to near IR. Widely tunable and narrow linewidth integrated lasers across all visible wavelengths are necessary to enable on chip technologies such as quantum photonics, optical trapping, and biophotonics. However, such lasers have not been realized due to the strong wavelength sensitivity and high loss of integrated optical devices at short wavelengths. Here we overcome these challenges and demonstrate a chip scale visible lasers platform by using tightly confined, micrometer scale silicon nitride resonators and commercial Fabry Perot laser diodes. We achieve tunable and narrow linewidth lasing in the deep blue (450 nm), blue (488 nm), green (520 nm), red (660 nm) and near IR (785 nm) with coarse tuning up to 12 nm, fine tuning up to 33.9 GHz, linewidth down to sub kHz, side mode suppression ratio 35 dB, and fiber coupled power up to 10 mW. These specifications of our chip scale lasers are comparable to those of state of the art commercial laser systems, making them stand out as powerful tools for the next generation of visible light technologies.


Computing with B series. We present BSeries.jl, a Julia package for the computation and manipulation of B series, which are a versatile theoretical tool for understanding and designing discretizations of differential equations. We give a short introduction to the theory of B series and associated concepts and provide examples of their use, including method composition and backward error analysis. The associated software is highly performant and makes it possible to work with B series of high order.


In Out Diverse Image Outpainting via GAN Inversion. Image outpainting seeks for a semantically consistent extension of the input image beyond its available content. Compared to inpainting filling in missing pixels in a way coherent with the neighboring pixels outpainting can be achieved in more diverse ways since the problem is less constrained by the surrounding pixels. Existing image outpainting methods pose the problem as a conditional image to image translation task, often generating repetitive structures and textures by replicating the content available in the input image. In this work, we formulate the problem from the perspective of inverting generative adversarial networks. Our generator renders micro patches conditioned on their joint latent code as well as their individual positions in the image. To outpaint an image, we seek for multiple latent codes not only recovering available patches but also synthesizing diverse outpainting by patch based generation. This leads to richer structure and content in the outpainted regions. Furthermore, our formulation allows for outpainting conditioned on the categorical input, thereby enabling flexible user controls. Extensive experimental results demonstrate the proposed method performs favorably against existing in and outpainting methods, featuring higher visual quality and diversity.


Metodos de Agrupamentos em dois Estagios. This work investigates the use of two stage clustering methods. Four techniques were proposed SOMK, SOMAK, ASCAK and SOINAK. SOMK is composed of a SOM (Self Organizing Maps) followed by the K means algorithm, SOMAK is a combination of SOM followed by the Ant K means (AK) algorithm, ASCAK is composed by the ASCA (Ant System based Clustering Algorithm) and AK algorithms, SOINAK is composed by the Self Organizing Incremental Neural Network (SOINN) and AK. SOINAK presented a better performance among the four proposed techniques when applied to pattern recognition problems.


A computationally efficient approach for the removal of the phase shift singularity in harmonic resolvent analysis. The recently introduced harmonic resolvent framework is concerned with the study of the input output dynamics of nonlinear flows in the proximity of a known time periodic orbit. These dynamics are governed by the harmonic resolvent operator, which is a linear operator in the frequency domain whose singular value decomposition sheds light on the dominant input output structures of the flow. Although the harmonic resolvent is a mathematically well defined operator, the numerical computation of its singular value decomposition requires inverting a matrix that becomes exactly singular as the periodic orbit approaches an exact solution of the nonlinear governing equations. The very poor condition properties of this matrix hinder the convergence of classical Krylov solvers, even in the presence of preconditioners, thereby increasing the computational cost required to perform the harmonic resolvent analysis. In this paper we show that a suitable augmentation of the (nearly) singular matrix removes the singularity, and we provide a lower bound for the smallest singular value of the augmented matrix. We also show that the desired decomposition of the harmonic resolvent can be computed using the augmented matrix, whose improved condition properties lead to a significant speedup in the convergence of classical iterative solvers. We demonstrate this simple, yet effective, computational procedure on the Kuramoto Sivashinsky equation in the proximity of an unstable time periodic orbit.


The Impact of Machine Learning on 2D 3D Registration for Image guided Interventions A Systematic Review and Perspective. Image based navigation is widely considered the next frontier of minimally invasive surgery. It is believed that image based navigation will increase the access to reproducible, safe, and high precision surgery as it may then be performed at acceptable costs and effort. This is because image based techniques avoid the need of specialized equipment and seamlessly integrate with contemporary workflows. Further, it is expected that image based navigation will play a major role in enabling mixed reality environments and autonomous, robotic workflows. A critical component of image guidance is 2D 3D registration, a technique to estimate the spatial relationships between 3D structures, e.g., volumetric imagery or tool models, and 2D images thereof, such as fluoroscopy or endoscopy. While image based 2D 3D registration is a mature technique, its transition from the bench to the bedside has been restrained by well known challenges, including brittleness of the optimization objective, hyperparameter selection, and initialization, difficulties around inconsistencies or multiple objects, and limited single view performance. One reason these challenges persist today is that analytical solutions are likely inadequate considering the complexity, variability, and high dimensionality of generic 2D 3D registration problems. The recent advent of machine learning based approaches to imaging problems that, rather than specifying the desired functional mapping, approximate it using highly expressive parametric models holds promise for solving some of the notorious challenges in 2D 3D registration. In this manuscript, we review the impact of machine learning on 2D 3D registration to systematically summarize the recent advances made by introduction of this novel technology. Grounded in these insights, we then offer our perspective on the most pressing needs, significant open problems, and possible next steps.


The periodic Plateau problem and its application. Given a noncompact disconnected complete periodic curve Gamma with no self intersection in mathbb R 3 , it is proved that there exists a noncompact simply connected periodic minimal surface spanning Gamma . As an application it is shown that for any tetrahedron T with dihedral angles leq90 circ there exist four embedded minimal annuli in T which are perpendicular to partial T along their boundary. It is also proved that every Platonic solid of mathbb R 3 contains five types of free boundary embedded minimal surfaces of genus zero.


DeepMetis Augmenting a Deep Learning Test Set to Increase its Mutation Score. Deep Learning (DL) components are routinely integrated into software systems that need to perform complex tasks such as image or natural language processing. The adequacy of the test data used to test such systems can be assessed by their ability to expose artificially injected faults (mutations) that simulate real DL faults. In this paper, we describe an approach to automatically generate new test inputs that can be used to augment the existing test set so that its capability to detect DL mutations increases. Our tool DeepMetis implements a search based input generation strategy. To account for the non determinism of the training and the mutation processes, our fitness function involves multiple instances of the DL model under test. Experimental results show that tool is effective at augmenting the given test set, increasing its capability to detect mutants by 63 on average. A leave one out experiment shows that the augmented test set is capable of exposing unseen mutants, which simulate the occurrence of yet undetected faults.


Mitigating the Position Bias of Transformer Models in Passage Re Ranking. Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in the position of the correct answer in the text in two popular Question Answering datasets used for passage re ranking. The excessive favoring of earlier positions inside passages is an unwanted artefact. This leads to three common Transformer based re ranking models to ignore relevant parts in unseen passages. More concerningly, as the evaluation set is taken from the same biased distribution, the models overfitting to that bias overestimate their true effectiveness. In this work we analyze position bias on datasets, the contextualized representations, and their effect on retrieval results. We propose a debiasing method for retrieval datasets. Our results show that a model trained on a position biased dataset exhibits a significant decrease in re ranking effectiveness when evaluated on a debiased dataset. We demonstrate that by mitigating the position bias, Transformer based re ranking models are equally effective on a biased and debiased dataset, as well as more effective in a transfer learning setting between two differently biased datasets.


Proceedings of the First Workshop on Weakly Supervised Learning (WeaSuL). Welcome to WeaSuL 2021, the First Workshop on Weakly Supervised Learning, co located with ICLR 2021. In this workshop, we want to advance theory, methods and tools for allowing experts to express prior coded knowledge for automatic data annotations that can be used to train arbitrary deep neural networks for prediction. The ICLR 2021 Workshop on Weak Supervision aims at advancing methods that help modern machine learning methods to generalize from knowledge provided by experts, in interaction with observable (unlabeled) data. In total, 15 papers were accepted. All the accepted contributions are listed in these Proceedings.


Optical Brewster metasurfaces exhibiting ultra broadband reflectionless absorption and extreme angular asymmetry. Impedance mismatch between free space and absorptive materials is a fundamental issue plaguing the pursue of high efficiency light absorption. In this work, we design and numerically demonstrate a type of non resonant impedance matched optical metasurfaces exhibiting ultra broadband reflectionless absorption based on anomalous Brewster effect, which are donated as optical Brewster metasurfaces here. Interestingly, such Brewster metasurfaces exhibit a unique type of extreme angular asymmetry a transition between perfect transparency and perfect absorption appears when the sign of the incident angle is changed. Such a remarkable phenomenon originates in the coexistence of traditional and anomalous Brewster effects. Guidelines of material selection based on an effective medium description and strategies such as the integration of a metal back reflector or folded metasurfaces are proposed to improve the absorption performance. Finally, a gradient optical Brewster metasurface exhibiting ultra broadband and near omnidirectional reflectionless absorption is demonstrated. Such high efficiency asymmetric optical metasurfaces may find applications in optoelectrical and thermal devices like photodetectors, thermal emitters and photovoltaics.


Neural population geometry An approach for understanding biological and artificial neural networks. Advances in experimental neuroscience have transformed our ability to explore the structure and function of neural circuits. At the same time, advances in machine learning have unleashed the remarkable computational power of artificial neural networks (ANNs). While these two fields have different tools and applications, they present a similar challenge namely, understanding how information is embedded and processed through high dimensional representations to solve complex tasks. One approach to addressing this challenge is to utilize mathematical and computational tools to analyze the geometry of these high dimensional representations, i.e., neural population geometry. We review examples of geometrical approaches providing insight into the function of biological and artificial neural networks representation untangling in perception, a geometric theory of classification capacity, disentanglement and abstraction in cognitive systems, topological representations underlying cognitive maps, dynamic untangling in motor systems, and a dynamical approach to cognition. Together, these findings illustrate an exciting trend at the intersection of machine learning, neuroscience, and geometry, in which neural population geometry provides a useful population level mechanistic descriptor underlying task implementation. Importantly, geometric descriptions are applicable across sensory modalities, brain regions, network architectures and timescales. Thus, neural population geometry has the potential to unify our understanding of structure and function in biological and artificial neural networks, bridging the gap between single neurons, populations and behavior.


Semi isotopic knots. A textit knot is a possibly wild simple closed curve in S 3 . A knot J is textit semi isotopic to a knot K if there is an annulus A in S 3 times 0,1 such that A cap(S 3 times 0,1 ) partial A (J times 0 ) cup(K times 1 ) and there is a homeomorphism e S 1 times 0,1) rightarrow A (K times 1 ) such that e(S 1 times t ) subset S 3 times t for every t in 0,1) . textbf Theorem. Every knot is semi isotopic to an unknot.


Multi dimensional Kronecker Sequences with a Small Number of Gap Lengths. Recently, generalizations of the classical Three Gap Theorem to higher dimensions attracted a lot of attention. In particular, upper bounds for the number of nearest neighbor distances have been established for the Euclidean and the maximum metric. It was proved that a generic multi dimensional Kronecker attains the maximal possible number of different gap lengths for every sub exponential subsequence. We mirror this result in dimension d in left 2, 3 right by constructing Kronecker sequences which have a surprisingly low number of different nearest neighbor distances for infinitely N in mathbb N . Our proof relies on simple arguments from the theory of continued fractions.


Transparent Electricity Pricing with Privacy. Smart grids leverage data from smart meters to improve operations management and to achieve cost reductions. The fine grained meter data also enable pricing schemes that simultaneously benefit electricity retailers and users. Our goal is to design a practical dynamic pricing protocol for smart grids in which the rate charged by a retailer depends on the total demand among its users. Realizing this goal is challenging because neither the retailer nor the users are trusted. The first challenge is to design a pricing scheme that incentivizes consumption behavior that leads to lower costs for both the users and the retailer. The second challenge is to prevent the retailer from tampering with the data, for example, by claiming that the total consumption is much higher than its real value. The third challenge is data privacy, that is, how to hide the meter data from adversarial users. To address these challenges, we propose a scheme in which peak rates are charged if either the total or the individual consumptions exceed some thresholds. We formally define a privacy preserving transparent pricing scheme (PPTP) that allows honest users to detect tampering at the retailer while ensuring data privacy. We present two instantiations of PPTP, and prove their security. Both protocols use secure commitments and zero knowledge proofs. We implement and evaluate the protocols on server and edge hardware, demonstrating that PPTP has practical performance at scale.


Multi particle reconstruction in the High Granularity Calorimeter using object condensation and graph neural networks. The high luminosity upgrade of the LHC will come with unprecedented physics and computing challenges. One of these challenges is the accurate reconstruction of particles in events with up to 200 simultaneous proton proton interactions. The planned CMS High Granularity Calorimeter offers fine spatial resolution for this purpose, with more than 6 million channels, but also poses unique challenges to reconstruction algorithms aiming to reconstruct individual particle showers. In this contribution, we propose an end to end machine learning method that performs clustering, classification, and energy and position regression in one step while staying within memory and computational constraints. We employ GravNet, a graph neural network, and an object condensation loss function to achieve this task. Additionally, we propose a method to relate truth showers to reconstructed showers by maximising the energy weighted intersection over union using maximal weight matching. Our results show the efficiency of our method and highlight a promising research direction to be investigated further.


A General Framework for Revealing Human Mind with auto encoding GANs. Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function. The traditional approach treats brain decoding as a classification problem, reading the mind through statistical analysis of brain activity. However, human thought is rich and varied, that it is often influenced by more of a combination of object features than a specific type of category. For this reason, we propose an end to end brain decoding framework which translates brain activity into an image by latent space alignment. To find the correspondence from brain signal features to image features, we embedded them into two latent spaces with modality specific encoders and then aligned the two spaces by minimising the distance between paired latent representations. The proposed framework was trained by simultaneous electroencephalogram and functional MRI data, which were recorded when the subjects were viewing or imagining a set of image stimuli. In this paper, we focused on implementing the fMRI experiment. Our experimental results demonstrated the feasibility of translating brain activity to an image. The reconstructed image matches image stimuli approximate in both shape and colour. Our framework provides a promising direction for building a direct visualisation to reveal human mind.


On Quotients of Values of Euler's Function on Factorials. Recently, there has been some interest in values of arithmetical functions on members of special sequences, such as Euler's totient function phi on factorials, linear recurrences, etc. In this article, we investigate, for given positive integers a and b , the least positive integer c c(a,b) such that the quotient phi(c!) phi(a!) phi(b!) is an integer. We derive results on the limit of the ratio c(a,b) (a b) as a and b tend to infinity. Furthermore, we show that c(a,b) a b for all pairs of positive integers (a,b) with an exception of a set of density zero.


Multiphysics mixed finite element method with Nitsche's technique for Stokes poroelasticity problem. In this paper, we propose a multiphysics mixed finite element method with Nitsche's technique for Stokes poroelasticity problem. Firstly, we present a multiphysics reformulation of poroelasticity part of the original problem by introducing two pseudo pressures to reveal the underlying deformation and diffusion multi physical processes in the Stokes poroelasticity problem. Then, we prove the existence and uniqueness of weak solution of the reformulated and original problem. And we use Nitsche's technique to approximate the coupling condition at the interface to propose a loosely coupled time stepping method multiphysics mixed finite element method for space variables, and we decouple the reformulated problem into three sub problems at each time step a Stokes problem, a generalized Stokes problem and a mixed diffusion problem. Also, we give the stability analysis and error estimates of the loosely coupled time stepping method.


Simple weight modules with finite weight multiplicities over the Lie algebra of polynomial vector fields. Let mathcal W n be the Lie algebra of polynomial vector fields. We classify simple weight mathcal W n modules M with finite weight multiplicities. We prove that every such nontrivial module M is either a tensor module or the unique simple submodule in a tensor module associated with the de Rham complex on mathbb C n .


Weak nonlinearity for strong nonnormality. We propose a theoretical approach to derive amplitude equations governing the weakly nonlinear evolution of nonnormal dynamical systems when they experience transient growth or respond to harmonic forcing. This approach reconciles the nonmodal nature of these growth mechanisms and the need for a center manifold to project the leading order dynamics. Under the hypothesis of strong nonnormality, we take advantage of the fact that small operator perturbations suffice to make the inverse resolvent and the inverse propagator singular, which we encompass in a multiple scale asymptotic expansion. The methodology is outlined for a generic nonlinear dynamical system, and four application cases highlight common nonnormal mechanisms in hydrodynamics the streamwise convective nonnormal amplification in the flow past a backward facing step, and the Orr and lift up mechanisms in the plane Poiseuille flow.


Text Summarization of Czech News Articles Using Named Entities. The foundation for the research of summarization in the Czech language was laid by the work of Straka et al. (2018). They published the SumeCzech, a large Czech news based summarization dataset, and proposed several baseline approaches. However, it is clear from the achieved results that there is a large space for improvement. In our work, we focus on the impact of named entities on the summarization of Czech news articles. First, we annotate SumeCzech with named entities. We propose a new metric ROUGE NE that measures the overlap of named entities between the true and generated summaries, and we show that it is still challenging for summarization systems to reach a high score in it. We propose an extractive summarization approach Named Entity Density that selects a sentence with the highest ratio between a number of entities and the length of the sentence as the summary of the article. The experiments show that the proposed approach reached results close to the solid baseline in the domain of news articles selecting the first sentence. Moreover, we demonstrate that the selected sentence reflects the style of reports concisely identifying to whom, when, where, and what happened. We propose that such a summary is beneficial in combination with the first sentence of an article in voice applications presenting news articles. We propose two abstractive summarization approaches based on Seq2Seq architecture. The first approach uses the tokens of the article. The second approach has access to the named entity annotations. The experiments show that both approaches exceed state of the art results previously reported by Straka et al. (2018), with the latter achieving slightly better results on SumeCzech's out of domain testing set.


Wake foil interactions and energy harvesting efficiency in tandem oscillating foils. Oscillating foils in synchronized pitch heave motions can be used to harvest hydrokinetic energy. By understanding the wake structure and its correlation with the foil kinematics, predictive models for how foils can operate in array configurations can be developed. To establish a relationship between foil kinematics and wake characteristics, a wide range of kinematics is explored in a two foil tandem configuration with interfoil spacing from four to nine chord lengths separation and multiple interfoil phases. Using data from experiments and simulations, an in depth wake analysis is performed and the mean velocity and the turbulent kinetic energy are quantified in the wake. With this energy quantification, the trailing foil efficiency is modified to account for the mean flow in addition to the energy transported by the coherent leading edge vortices (LEVs) shed from the leading foil. With the mean wake velocity, a predictive wake model is able to distinguish three regimes through analyzing trailing foil efficiency profiles and the strength of the primary LEV shed from the leading foil. Dividing the wake into regimes is an insightful way to narrow the range of foil kinematics and configurations and improve the energy harvesting in a two tandem foil array.


The free m cone of a matroid and its mathcal G invariant. For a matroid M , its configuration determines its mathcal G invariant. Few examples are known of pairs of matroids with the same mathcal G invariant but different configurations. In order to produce new examples, we introduce the free m cone Q m(M) of a loopless matroid M , where m is a positive integer. We show that the mathcal G invariant of M determines the mathcal G invariant of Q m(M) , and that the configuration of Q m(M) determines M so if M and N are nonisomorphic and have the same mathcal G invariant, then Q m(M) and Q m(N) have the same mathcal G invariant but different configurations. We prove analogous results for several variants of the free m cone. We also define a new matroid invariant of M , and show that it determines the Tutte polynomial of Q m(M) .


On Moment Approximation and the Effective Putinar's Positivstellensatz. We analyse the representation of positive polynomials in terms of Sums of Squares. We provide a quantitative version of Putinar Positivstellensatz over a compact basic closed semialgebraic set S, with new polynomial bounds on the degree of the positivity certificates. These bounds involve a Lojasiewicz exponent associated to the description of S. We show that under Constraint Qualification Conditions, this Lojasiewicz exponent is equal to 1. We deduce new bounds on the convergence rate of the optima in Lasserre Sum of Squares hierarchy to the global optimum of a polynomial function on S and new bounds on the Hausdorff distance between the cone of truncated (probability) measures supported on S and the cone of truncated moment sequences, which are positive on the quadratic module of S.


Development of Econophysics A biased account and perspective from Kolkata. We present here a somewhat personalized account of the emergence of econophysics as an attractive research topic in physical as well as social sciences. After a rather detailed story telling about our endeavors from Kolkata, we give a brief description of the main research achievements in a simple and non technical language. We also present briefly, in technical language, a piece of our recent research result. We conclude our paper with a brief perspective.


Maximally Mutable Laurent Polynomials. We introduce a class of Laurent polynomials, called maximally mutable Laurent polynomials (MMLPs), that we believe correspond under mirror symmetry to Fano varieties. A subclass of these, called rigid, are expected to correspond to Fano varieties with terminal locally toric singularities. We prove that there are exactly 10 mutation classes of rigid MMLPs in two variables under mirror symmetry these correspond one to one with the 10 deformation classes of smooth del Pezzo surfaces. Furthermore we give a computer assisted classification of rigid MMLPs in three variables with reflexive Newton polytope under mirror symmetry these correspond one to one with the 98 deformation classes of three dimensional Fano manifolds with very ample anticanonical bundle. We compare our proposal to previous approaches to constructing mirrors to Fano varieties, and explain why mirror symmetry in higher dimensions necessarily involves varieties with terminal singularities. Every known mirror to a Fano manifold, of any dimension, is a rigid MMLP.


Approximating continuous function on orbit spaces. In this paper we study a subclass of subcartesian space the orbit space of a proper action of Lie group on smooth manifold. We show that continuous functions on orbit space can be approximated by smooth functions.


HydraSum Disentangling Stylistic Features in Text Summarization using Multi Decoder Models. Existing abstractive summarization models lack explicit control mechanisms that would allow users to influence the stylistic features of the model outputs. This results in generating generic summaries that do not cater to the users needs or preferences. To address this issue we introduce HydraSum, a new summarization architecture that extends the single decoder framework of current models, e.g. BART, to a mixture of experts version consisting of multiple decoders. Our proposed model encourages each expert, i.e. decoder, to learn and generate stylistically distinct summaries along dimensions such as abstractiveness, length, specificity, and others. At each time step, HydraSum employs a gating mechanism that decides the contribution of each individual decoder to the next token's output probability distribution. Through experiments on three summarization datasets (CNN, Newsroom, XSum), we demonstrate that this gating mechanism automatically learns to assign contrasting summary styles to different HydraSum decoders under the standard training objective without the need for additional supervision. We further show that a guided version of the training process can explicitly govern which summary style is partitioned between decoders, e.g. high abstractiveness vs. low abstractiveness or high specificity vs. low specificity, and also increase the stylistic difference between individual decoders. Finally, our experiments demonstrate that our decoder framework is highly flexible during inference, we can sample from individual decoders or mixtures of different subsets of the decoders to yield a diverse set of summaries and enforce single and multi style control over summary generation.


Can Taxonomy Help? Improving Semantic Question Matching using Question Taxonomy. In this paper, we propose a hybrid technique for semantic question matching. It uses our proposed two layered taxonomy for English questions by augmenting state of the art deep learning models with question classes obtained from a deep learning based question classifier. Experiments performed on three open domain datasets demonstrate the effectiveness of our proposed approach. We achieve state of the art results on partial ordering question ranking (POQR) benchmark dataset. Our empirical analysis shows that coupling standard distributional features (provided by the question encoder) with knowledge from taxonomy is more effective than either deep learning (DL) or taxonomy based knowledge alone.


Simultaneous 2D and 3D turbulent flows in Faraday Waves. In nature turbulent flows exist that are neither simply 2D nor 3D but boundary conditions, such as varying stratification, force them towards the one or the other. Here, we report the first evidence of the co existence of 2D and 3D turbulence in an experimental flow driven by Faraday waves in water. We find that an inverse energy cascade at the fluid surface and a direct energy cascade in the 3D bulk flow underneath exist simultaneously. We base our analysis on temporally and spatially well resolved velocity fields measured at horizontal and vertical planes. The findings suggest that the strongly turbulent 2D surface flow drives the 3D bulk flow through sporadic vertical jets as a source of momentum.


Profile decomposition in Sobolev spaces and decomposition of integral functionals I inhomogeneous case. The present paper is devoted to analysis of the lack of compactness of bounded sequences in emph inhomogeneous Sobolev spaces, where bounded sequences might fail to be compact due to an isometric group action, that is, emph translation . It will be proved that every bounded sequence (u n) has (possibly infinitely many) emph profiles , and then the sequence is asymptotically decomposed into a sum of translated profiles and a double suffixed residual term, where the residual term becomes arbitrarily small in appropriate Lebesgue or Sobolev spaces of lower order. To this end, functional analytic frameworks are established in an abstract way by making use of a group action G , in order to characterize profiles by (u n) and G . One also finds that a decomposition of the Sobolev norm into profiles is bounded by the supremum of the norm of u n . Moreover, the profile decomposition leads to results of decomposition of integral functionals of subcritical order. It is noteworthy that the space where the decomposition of integral functionals holds is the same as that where the residual term is vanishing.


Stability analysis and control of decision making of miners in blockchain. To maintain blockchain based services with ensuring its security, it is an important issue how to decide a mining reward so that the number of miners participating in the mining increases. We propose a dynamical model of decision making for miners using an evolutionary game approach and analyze the stability of equilibrium points of the proposed model. The proposed model is described by the 1st order differential equation. So, it is simple but its theoretical analysis gives an insight into the characteristics of the decision making. Through the analysis of the equilibrium points, we show the transcritical bifurcations and hysteresis phenomena of the equilibrium points. We also design a controller that determines the mining reward based on the number of participating miners to stabilize the state that all miners participate in the mining. Numerical simulation shows that there is a trade off in the choice of the design parameters.


There are only a finite number of excluded minors for the class of bicircular matroids. We show that the class of bicircular matroids has only a finite number of excluded minors. Key tools used in our proof include representations of matroids by biased graphs and the recently introduced class of quasi graphic matroids. We show that if N is an excluded minor of rank at least eight, then N is quasi graphic. Several small excluded minors are quasi graphic. Using biased graphic representations, we find that N already contains one of these. We also provide an upper bound, in terms of rank, on the number of elements in an excluded minor, so the result follows.


Active 3D Shape Reconstruction from Vision and Touch. Humans build 3D understandings of the world through active object exploration, using jointly their senses of vision and touch. However, in 3D shape reconstruction, most recent progress has relied on static datasets of limited sensory data such as RGB images, depth maps or haptic readings, leaving the active exploration of the shape largely unexplored. Inactive touch sensing for 3D reconstruction, the goal is to actively select the tactile readings that maximize the improvement in shape reconstruction accuracy. However, the development of deep learning based active touch models is largely limited by the lack of frameworks for shape exploration. In this paper, we focus on this problem and introduce a system composed of 1) a haptic simulator leveraging high spatial resolution vision based tactile sensors for active touching of 3D objects 2)a mesh based 3D shape reconstruction model that relies on tactile or visuotactile signals and 3) a set of data driven solutions with either tactile or visuotactile priors to guide the shape exploration. Our framework enables the development of the first fully data driven solutions to active touch on top of learned models for object understanding. Our experiments show the benefits of such solutions in the task of 3D shape understanding where our models consistently outperform natural baselines. We provide our framework as a tool to foster future research in this direction.


The ternary Goldbach problem with a prime with a missing digit and primes of special types. Let gamma frac 8 9 frac 2 3 frac log(10 9) log 10 ( approx 0.919 ldots) , gamma frac 1 c 0 leq 1 . Let gamma gamma 0 leq 1 , c 0 1 gamma 0 be fixed. Let also a 0 in 0,1, ldots, 9 . In 23 we proved on assumption of the Generalized Riemann Hypothesis (GRH), that each sufficiently large odd integer N 0 can be represented in the form N 0 p 1 p 2 p 3 , where for i 2, 3 the primes p i are Piatetski Shapiro primes primes of the form p i n i c 0 , n i in mathbb N whereas the decimal expansion of p 1 does not contain the digit a 0 . In this paper we replace one of the Piatetski Shapiro primes p 2 and p 3 by primes of the type p x 2 y 2 1 .


Performance Bounds for PDE Constrained Optimization under Uncertainty. Computational approaches to PDE constrained optimization under uncertainty may involve finite dimensional approximations of control and state spaces, sample average approximations of measures of risk and reliability, smooth approximations of nonsmooth functions, penalty approximations of constraints as well as many other kinds of inaccuracies. In this paper, we analyze the performance of controls obtained by an approximation based algorithm and in the process develop estimates of optimality gaps for general optimization problems defined on metric spaces. Under mild assumptions, we establish that limiting controls have arbitrarily small optimality gaps provided that the inaccuracies in the various approximations vanish. We carry out the analysis for a broad class of problems with multiple expectation, risk, and reliability functions involving PDE solutions and appearing in objective as well as constraint expressions. In particular, we address problems with buffered failure probability constraints approximated via an augmented Lagrangian. We demonstrate the framework on an elliptic PDE with a random coefficient field and a distributed control function.


A Survey on Deep Domain Adaptation and Tiny Object Detection Challenges, Techniques and Datasets. This survey paper specially analyzed computer vision based object detection challenges and solutions by different techniques. We mainly highlighted object detection by three different trending strategies, i.e., 1) domain adaptive deep learning based approaches (discrepancy based, Adversarial based, Reconstruction based, Hybrid). We examined general as well as tiny object detection related challenges and offered solutions by historical and comparative analysis. In part 2) we mainly focused on tiny object detection techniques (multi scale feature learning, Data augmentation, Training strategy (TS), Context based detection, GAN based detection). In part 3), To obtain knowledge able findings, we discussed different object detection methods, i.e., convolutions and convolutional neural networks (CNN), pooling operations with trending types. Furthermore, we explained results with the help of some object detection algorithms, i.e., R CNN, Fast R CNN, Faster R CNN, YOLO, and SSD, which are generally considered the base bone of CV, CNN, and OD. We performed comparative analysis on different datasets such as MS COCO, PASCAL VOC07,12, and ImageNet to analyze results and present findings. At the end, we showed future directions with existing challenges of the field. In the future, OD methods and models can be analyzed for real time object detection, tracking strategies.


Survey about cyberattack protection motivation in higher education Academics at Slovenian universities, 2017. This paper reports on a study aiming to explore factors associated with motivation of individuals in organizations to protect against cyberattacks. The objectives of this study were to determine how fear of cyberattacks, perceived severity, perceived vulnerability, perceived threats, measure efficacy, self efficacy, measure costs, mandatoriness and psychological reactance are associated with protection motivation of individuals in organizations. The study employed a cross sectional research design. A survey was conducted among academics at six Slovenian universities between June and September 2017. A total of 324 respondents completed the survey (7.6 percent response rate) providing for N 255 useful responses after excluding poorly completed responses. The survey questionnaire was developed in English. A Slovenian translation of the survey questionnaire is available.


Automatic evaluation of scientific abstracts through natural language processing. This work presents a framework to classify and evaluate distinct research abstract texts which are focused on the description of processes and their applications. In this context, this paper proposes natural language processing algorithms to classify, segment and evaluate the results of scientific work. Initially, the proposed framework categorize the abstract texts into according to the problems intended to be solved by employing a text classification approach. Then, the abstract text is segmented into problem description, methodology and results. Finally, the methodology of the abstract is ranked based on the sentiment analysis of its results. The proposed framework allows us to quickly rank the best methods to solve specific problems. To validate the proposed framework, oil production anomaly abstracts were experimented and achieved promising results.


Prototype based Personalized Pruning. Nowadays, as edge devices such as smartphones become prevalent, there are increasing demands for personalized services. However, traditional personalization methods are not suitable for edge devices because retraining or finetuning is needed with limited personal data. Also, a full model might be too heavy for edge devices with limited resources. Unfortunately, model compression methods which can handle the model complexity issue also require the retraining phase. These multiple training phases generally need huge computational cost during on device learning which can be a burden to edge devices. In this work, we propose a dynamic personalization method called prototype based personalized pruning (PPP). PPP considers both ends of personalization and model efficiency. After training a network, PPP can easily prune the network with a prototype representing the characteristics of personal data and it performs well without retraining or finetuning. We verify the usefulness of PPP on a couple of tasks in computer vision and Keyword spotting.


VIPriors 1 Visual Inductive Priors for Data Efficient Deep Learning Challenges. We present the first edition of "VIPriors Visual Inductive Priors for Data Efficient Deep Learning" challenges. We offer four data impaired challenges, where models are trained from scratch, and we reduce the number of training samples to a fraction of the full set. Furthermore, to encourage data efficient solutions, we prohibited the use of pre trained models and other transfer learning techniques. The majority of top ranking solutions make heavy use of data augmentation, model ensembling, and novel and efficient network architectures to achieve significant performance increases compared to the provided baselines.


Fullness of exceptional collections via stability conditions A case study the quadric threefold. A powerful tool of investigation of Fano varieties is provided by exceptional collections in their derived categories. Proving the fullness of such a collection is generally a nontrvial problem, usually solved on a case by case basis, with the aid of a deep understanding of the underlying geometry. Likewise, when an exceptional collection is not full, it is not straightforward to determine whether its "residual" category, i.e., its right orthogonal, is the derived category of a variety. We show how one can use the existence of Bridgeland stability condition these residual categories (when they exist) to address these problems. We examine a simple case in detail the quadric threefold Q 3 in mathbb P 4 . We also give an indication how a variety of other classical results could be justified or re discovered via this technique., e.g., the commutativity of the Kuznetsov component of the Fano threefold Y 4 .


Anomaly Detection in Dynamic Graphs via Transformer. Detecting anomalies for dynamic graphs has drawn increasing attention due to their wide applications in social networks, e commerce, and cybersecurity. Recent deep learning based approaches have shown promising results over shallow methods. However, they fail to address two core challenges of anomaly detection in dynamic graphs the lack of informative encoding for unattributed nodes and the difficulty of learning discriminate knowledge from coupled spatial temporal dynamic graphs. To overcome these challenges, in this paper, we present a novel Transformer based Anomaly Detection framework for DYnamic graphs (TADDY). Our framework constructs a comprehensive node encoding strategy to better represent each node's structural and temporal roles in an evolving graphs stream. Meanwhile, TADDY captures informative representation from dynamic graphs with coupled spatial temporal patterns via a dynamic graph transformer model. The extensive experimental results demonstrate that our proposed TADDY framework outperforms the state of the art methods by a large margin on six real world datasets.


A Robust and Accurate Approach to Detect Process Drifts from Event Streams. Business processes are bound to evolve as a form of adaption to changes, and such changes are referred as process drifts. Current process drift detection methods perform well on clean event log data, but the performance can be tremendously affected by noises. A good process drift detection method should be accurate, fast, and robust to noises. In this paper, we propose an offline process drift detection method which identifies each newly observed behaviour as a candidate drift point and checks if the new behaviour can signify significant changes to the original process behaviours. In addition, a bidirectional search method is proposed to accurately locate both the adding and removing of behaviours. The proposed method can accurately detect drift points from event logs and is robust to noises. Both artificial and real life event logs are used to evaluate our method. Results show that our method can consistently report accurate process drift time while maintaining a reasonably fast detection speed.


Low Shot Validation Active Importance Sampling for Estimating Classifier Performance on Rare Categories. For machine learning models trained with limited labeled training data, validation stands to become the main bottleneck to reducing overall annotation costs. We propose a statistical validation algorithm that accurately estimates the F score of binary classifiers for rare categories, where finding relevant examples to evaluate on is particularly challenging. Our key insight is that simultaneous calibration and importance sampling enables accurate estimates even in the low sample regime ( 300 samples). Critically, we also derive an accurate single trial estimator of the variance of our method and demonstrate that this estimator is empirically accurate at low sample counts, enabling a practitioner to know how well they can trust a given low sample estimate. When validating state of the art semi supervised models on ImageNet and iNaturalist2017, our method achieves the same estimates of model performance with up to 10x fewer labels than competing approaches. In particular, we can estimate model F1 scores with a variance of 0.005 using as few as 100 labels.


Characterizing Impacts of Storage Faults on HPC Applications A Methodology and Insights. In recent years, the increasing complexity in scientific simulations and emerging demands for training heavy artificial intelligence models require massive and fast data accesses, which urges high performance computing (HPC) platforms to equip with more advanced storage infrastructures such as solid state disks (SSDs). While SSDs offer high performance I O, the reliability challenges faced by the HPC applications under the SSD related failures remains unclear, in particular for failures resulting in data corruptions. The goal of this paper is to understand the impact of SSD related faults on the behaviors of complex HPC applications. To this end, we propose FFIS, a FUSE based fault injection framework that systematically introduces storage faults into the application layer to model the errors originated from SSDs. FFIS is able to plant different I O related faults into the data returned from underlying file systems, which enables the investigation on the error resilience characteristics of the scientific file format. We demonstrate the use of FFIS with three representative real HPC applications, showing how each application reacts to the data corruptions, and provide insights on the error resilience of the widely adopted HDF5 file format for the HPC applications.


A Study on Fairness and Trust Perceptions in Automated Decision Making. Automated decision systems are increasingly used for consequential decision making for a variety of reasons. These systems often rely on sophisticated yet opaque models, which do not (or hardly) allow for understanding how or why a given decision was arrived at. This is not only problematic from a legal perspective, but non transparent systems are also prone to yield undesirable (e.g., unfair) outcomes because their sanity is difficult to assess and calibrate in the first place. In this work, we conduct a study to evaluate different attempts of explaining such systems with respect to their effect on people's perceptions of fairness and trustworthiness towards the underlying mechanisms. A pilot study revealed surprising qualitative insights as well as preliminary significant effects, which will have to be verified, extended and thoroughly discussed in the larger main study.


GenSF Simultaneous Adaptation of Generative Pre trained Models and Slot Filling. In transfer learning, it is imperative to achieve strong alignment between a pre trained model and a downstream task. Prior work has done this by proposing task specific pre training objectives, which sacrifices the inherent scalability of the transfer learning paradigm. We instead achieve strong alignment by simultaneously modifying both the pre trained model and the formulation of the downstream task, which is more efficient and preserves the scalability of transfer learning. We present GenSF (Generative Slot Filling), which leverages a generative pre trained open domain dialog model for slot filling. GenSF (1) adapts the pre trained model by incorporating inductive biases about the task and (2) adapts the downstream task by reformulating slot filling to better leverage the pre trained model's capabilities. GenSF achieves state of the art results on two slot filling datasets with strong gains in few shot and zero shot settings. We achieve a 9 F1 score improvement in zero shot slot filling. This highlights the value of strong alignment between the pre trained model and the downstream task.


Uncertainty aware deep learning for robot touch Application to Bayesian tactile servo control. This work investigates uncertainty aware deep learning (DL) in tactile robotics based on a general framework introduced recently for robot vision. For a test scenario, we consider optical tactile sensing in combination with DL to estimate the edge pose as a feedback signal to servo around various 2D test objects. We demonstrate that uncertainty aware DL can improve the pose estimation over deterministic DL methods. The system estimates the uncertainty associated with each prediction, which is used along with temporal coherency to improve the predictions via a Kalman filter, and hence improve the tactile servo control. The robot is able to robustly follow all of the presented contour shapes to reduce not only the error by a factor of two but also smooth the trajectory from the undesired noisy behaviour caused by previous deterministic networks. In our view, as the field of tactile robotics matures in its use of DL, the estimation of uncertainty will become a key component in the control of physically interactive tasks in complex environments.


Surgical navigation systems based on augmented reality technologies. This study considers modern surgical navigation systems based on augmented reality technologies. Augmented reality glasses are used to construct holograms of the patient's organs from MRI and CT data, subsequently transmitted to the glasses. This, in addition to seeing the actual patient, the surgeon gains visualization inside the patient's body (bones, soft tissues, blood vessels, etc.). The solutions developed at Peter the Great St. Petersburg Polytechnic University allow reducing the invasiveness of the procedure and preserving healthy tissues. This also improves the navigation process, making it easier to estimate the location and size of the tumor to be removed. We describe the application of developed systems to different types of surgical operations (removal of a malignant brain tumor, removal of a cyst of the cervical spine). We consider the specifics of novel navigation systems designed for anesthesia, for endoscopic operations. Furthermore, we discuss the construction of novel visualization systems for ultrasound machines. Our findings indicate that the technologies proposed show potential for telemedicine.


Voter Perceptions of Trust in Risk Limiting Audits. Risk limiting audits (RLAs) are expected to strengthen the public confidence in the correctness of an election outcome. We hypothesize that this is not always the case, in part because for large margins between the winner and the runner up, the number of ballots to be drawn can be so small that voters lose confidence. We conduct a user study with 105 participants resident in the US. Our findings confirm the hypothesis, showing that our study participants felt less confident when they were told the number of ballots audited for RLAs. We elaborate on our findings and propose recommendations for future use of RLAs.


Count Less A Counting Sketch for the Data Plane of High Speed Switches. Demands are increasing to measure per flow statistics in the data plane of high speed switches. Measuring flows with exact counting is infeasible due to processing and memory constraints, but a sketch is a promising candidate for collecting approximately per flow statistics in data plane in real time. Among them, Count Min sketch is a versatile tool to measure spectral density of high volume data using a small amount of memory and low processing overhead. Due to its simplicity and versatility, Count Min sketch and its variants have been adopted in many works as a stand alone or even as a supporting measurement tool. However, Count Min's estimation accuracy is limited owing to its data structure not fully accommodating Zipfian distribution and the indiscriminate update algorithm without considering a counter value. This in turn degrades the accuracy of heavy hitter, heavy changer, cardinality, and entropy. To enhance measurement accuracy of Count Min, there have been many and various attempts. One of the most notable approaches is to cascade multiple sketches in a sequential manner so that either mouse or elephant flows should be filtered to separate elephants from mouse flows such as Elastic sketch (an elephant filter leveraging TCAM Count Min) and FCM sketch (Count Min based layered mouse filters). In this paper, we first show that these cascaded filtering approaches adopting a Pyramid shaped data structure (allocating more counters for mouse flows) still suffer from under utilization of memory, which gives us a room for better estimation. To this end, we are facing two challenges one is (a) how to make Count Min's data structure accommodate more effectively Zipfian distribution, and the other is (b) how to make update and query work without delaying packet processing in the switch's data plane. Count Less adopts a different combination ...


A Semidefinite Framework for the Sieve. We describe a semidefinite programming framework for proving upper bounds on concrete sifting problems, and show that the Large Sieve can be interpreted as a special case of this framework. With a small tweak, the Larger Sieve also falls into this framework. We compare the semidefinite approach to the linear programming approach (i.e., the general framework of the combinatorial sieve and the Selberg sieve), and show that it has a qualitative advantage in a toy case where the primes are completely independent from each other. No new sieve theoretic bounds are proved.


Pointer over Attention An Improved Bangla Text Summarization Approach Using Hybrid Pointer Generator Network. Despite the success of the neural sequence to sequence model for abstractive text summarization, it has a few shortcomings, such as repeating inaccurate factual details and tending to repeat themselves. We propose a hybrid pointer generator network to solve the shortcomings of reproducing factual details inadequately and phrase repetition. We augment the attention based sequence to sequence using a hybrid pointer generator network that can generate Out of Vocabulary words and enhance accuracy in reproducing authentic details and a coverage mechanism that discourages repetition. It produces a reasonable sized output text that preserves the conceptual integrity and factual information of the input article. For evaluation, we primarily employed "BANSData" a highly adopted publicly available Bengali dataset. Additionally, we prepared a large scale dataset called "BANS 133" which consists of 133k Bangla news articles associated with human generated summaries. Experimenting with the proposed model, we achieved ROUGE 1 and ROUGE 2 scores of 0.66, 0.41 for the "BANSData" dataset and 0.67, 0.42 for the BANS 133k" dataset, respectively. We demonstrated that the proposed system surpasses previous state of the art Bengali abstractive summarization techniques and its stability on a larger dataset. "BANS 133" datasets and code base will be publicly available for research.


Pathological examples of structures with o minimal open core. This paper answers several open questions around structures with o minimal open core. We construct an expansion of an o minimal structure mathcal R by a unary predicate such that its open core is a proper o minimal expansion of mathcal R . We give an example of a structure that has an o minimal open core and the exchange property, yet defines a function whose graph is dense. Finally, we produce an example of a structure that has an o minimal open core and definable Skolem functions, but is not o minimal.


Security Assessment Rating Framework for Enterprises using MITRE ATT CK Matrix. Threats targeting cyberspace are becoming more prominent and intelligent day by day. This inherently leads to a dire demand for continuous security validation and testing. Using this paper, we aim to provide a holistic and precise security analysis rating framework for organizations that increases the overall coherency of the outcomes of such testing. This scorecard is based on the security assessment performed following the globally accessible knowledge base of adversary tactics and techniques called the MITRE ATTACK matrix. The scorecard for an evaluation is generated by ingesting the security testing results into our framework, which provides an organizations overall risk assessment rating and the risk related to each of the different tactics from the ATTACK matrix.


Multi Sensor Fusion based Robust Row Following for Compact Agricultural Robots. This paper presents a state of the art LiDAR based autonomous navigation system for under canopy agricultural robots. Under canopy agricultural navigation has been a challenging problem because GNSS and other positioning sensors are prone to significant errors due to attentuation and multi path caused by crop leaves and stems. Reactive navigation by detecting crop rows using LiDAR measurements is a better alternative to GPS but suffers from challenges due to occlusion from leaves under the canopy. Our system addresses this challenge by fusing IMU and LiDAR measurements using an Extended Kalman Filter framework on low cost hardwware. In addition, a local goal generator is introduced to provide locally optimal reference trajectories to the onboard controller. Our system is validated extensively in real world field environments over a distance of 50.88 km on multiple robots in different field conditions across different locations. We report state of the art distance between intervention results, showing that our system is able to safely navigate without interventions for 386.9 m on average in fields without significant gaps in the crop rows, 56.1 m in production fields and 47.5 m in fields with gaps (space of 1 m without plants in both sides of the row).


Ghost imaging enhanced non invasive spectral characterization of stochastic x ray free electron laser pulses. High intensity ultrashort X ray free electron laser (XFEL) pulses are revolutionizing the study of fundamental nonlinear x ray matter interactions and coupled electronic and nuclear dynamics. To fully exploit the potential of this powerful tool for advanced x ray spectroscopies, a noninvasive spectral characterization of incident stochastic XFEL pulses with high resolution is a key requirement. Here we present a new methodology that combines high acceptance angle resolved photoelectron time of flight spectroscopy and ghost imaging to dramatically enhance the quality of spectral characterization of x ray free electron laser pulses. Implementation of this non invasive high resolution x ray diagnostic can greatly benefit the ultrafast x ray spectroscopy community by functioning as a transparent beamsplitter for applications such as transient absorption spectroscopy as well as covariance based x ray nonlinear spectroscopies where the shot to shot fluctuations inherent to a SASE XFEL pulse are a powerful asset.


Gradient Imitation Reinforcement Learning for Low Resource Relation Extraction. Low resource Relation Extraction (LRE) aims to extract relation facts from limited labeled corpora when human annotation is scarce. Existing works either utilize self training scheme to generate pseudo labels that will cause the gradual drift problem, or leverage meta learning scheme which does not solicit feedback explicitly. To alleviate selection bias due to the lack of feedback loops in existing LRE learning paradigms, we developed a Gradient Imitation Reinforcement Learning method to encourage pseudo label data to imitate the gradient descent direction on labeled data and bootstrap its optimization capability through trial and error. We also propose a framework called GradLRE, which handles two major scenarios in low resource relation extraction. Besides the scenario where unlabeled data is sufficient, GradLRE handles the situation where no unlabeled data is available, by exploiting a contextualized augmentation method to generate data. Experimental results on two public datasets demonstrate the effectiveness of GradLRE on low resource relation extraction when comparing with baselines.


ADDS Adaptive Differentiable Sampling for Robust Multi Party Learning. Distributed multi party learning provides an effective approach for training a joint model with scattered data under legal and practical constraints. However, due to the quagmire of a skewed distribution of data labels across participants and the computation bottleneck of local devices, how to build smaller customized models for clients in various scenarios while providing updates appliable to the central model remains a challenge. In this paper, we propose a novel adaptive differentiable sampling framework (ADDS) for robust and communication efficient multi party learning. Inspired by the idea of dropout in neural networks, we introduce a network sampling strategy in the multi party setting, which distributes different subnets of the central model to clients for updating, and the differentiable sampling rates allow each client to extract optimal local architecture from the supernet according to its private data distribution. The approach requires minimal modifications to the existing multi party learning structure, and it is capable of integrating local updates of all subnets into the supernet, improving the robustness of the central model. The proposed framework significantly reduces local computation and communication costs while speeding up the central model convergence, as we demonstrated through experiments on real world datasets.


Multi turn Dialog System on Single turn Data in Medical Domain. Recently there has been a huge interest in dialog systems. This interest has also been developed in the field of the medical domain where researchers are focusing on building a dialog system in the medical domain. This research is focused on the multi turn dialog system trained on the multi turn dialog data. It is difficult to gather a huge amount of multi turn conversational data in the medical domain that is verified by professionals and can be trusted. However, there are several frequently asked questions (FAQs) or single turn QA pairs that have information that is verified by the experts and can be used to build a multi turn dialog system.


Dense Extreme Inception Network for Edge Detection. Edge detection is the basis of many computer vision applications. State of the art predominantly relies on deep learning with two decisive factors dataset content and network's architecture. Most of the publicly available datasets are not curated for edge detection tasks. Here, we offer a solution to this constraint. First, we argue that edges, contours and boundaries, despite their overlaps, are three distinct visual features requiring separate benchmark datasets. To this end, we present a new dataset of edges. Second, we propose a novel architecture, termed Dense Extreme Inception Network for Edge Detection (DexiNed), that can be trained from scratch without any pre trained weights. DexiNed outperforms other algorithms in the presented dataset. It also generalizes well to other datasets without any fine tuning. The higher quality of DexiNed is also perceptually evident thanks to the sharper and finer edges it outputs.


Delay dependent and delay independent stability of Cournot duopoly model with tax evasion and time delay. In this paper a stability analysis for a Cournot duopoly model with tax evasion and time delay in a continuous time framework is presented. The mathematical model under consideration follows a gradient dynamics approach, is nonlinear and four dimensional with state variables given by the production and declared revenue of each competitor. We prove that both the marginal cost rate and time delay play roles as bifurcation parameters. More precisely, if the marginal cost rate lies in certain closed interval then the equilibrium point is delay independent stable, otherwise it is delay dependent stable and a Hopf bifurcation necessarily occurs. Some numerical simulations are presented in order to confirm the proposed theoretical results and illustrate the effect of the bifurcation parameters on model stability.


Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers. Recently multimodal transformer models have gained popularity because their performance on language and vision tasks suggest they learn rich visual linguistic representations. Focusing on zero shot image retrieval tasks, we study three important factors which can impact the quality of learned representations pretraining data, the attention mechanism, and loss functions. By pretraining models on six datasets, we observe that dataset noise and language similarity to our downstream task are important indicators of model performance. Through architectural analysis, we learn that models with a multimodal attention mechanism can outperform deeper models with modality specific attention mechanisms. Finally, we show that successful contrastive losses used in the self supervised learning literature do not yield similar performance gains when used in multimodal transformers


Control of a fly mimicking flyer in complex flow using deep reinforcement learning. An integrated framework of computational fluid structural dynamics (CFD CSD) and deep reinforcement learning (deep RL) is developed for control of a fly scale flexible winged flyer in complex flow. Dynamics of the flyer in complex flow is highly unsteady and nonlinear, which makes modeling the dynamics challenging. Thus, conventional control methodologies, where the dynamics is modeled, are insufficient for regulating such complicated dynamics. Therefore, in the present study, the integrated framework, in which the whole governing equations for fluid and structure are solved, is proposed to generate a control policy for the flyer. For the deep RL to successfully learn the control policy, accurate and ample data of the dynamics are required. However, satisfying both the quality and quantity of the data on the intricate dynamics is extremely difficult since, in general, more accurate data are more costly. In the present study, two strategies are proposed to deal with the dilemma. To obtain accurate data, the CFD CSD is adopted for precisely predicting the dynamics. To gain ample data, a novel data reproduction method is devised, where the obtained data are replicated for various situations while conserving the dynamics. With those data, the framework learns the control policy in various flow conditions and the learned policy is shown to have remarkable performance in controlling the flyer in complex flow fields.


The 5th Recognizing Families in the Wild Data Challenge Predicting Kinship from Faces. Recognizing Families In the Wild (RFIW), held as a data challenge in conjunction with the 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG), is a large scale, multi track visual kinship recognition evaluation. For the fifth edition of RFIW, we continue to attract scholars, bring together professionals, publish new work, and discuss prospects. In this paper, we summarize submissions for the three tasks of this year's RFIW specifically, we review the results for kinship verification, tri subject verification, and family member search and retrieval. We look at the RFIW problem, share current efforts, and make recommendations for promising future directions.


Identifying Influential Nodes in Weighted Networks using k shell based HookeRank Algorithm. Finding influential spreaders is a crucial task in the field of network analysis because of numerous theoretical and practical importance. These nodes play vital roles in the information diffusion process, like viral marketing. Many real life networks are weighted networks, but relatively less work has been done for finding influential nodes in the case of weighted networks as compared to unweighted networks. In this paper, we propose a k shell based HookeRank (KSHR) algorithm to identify spreaders in weighted networks. First, we propose weighted k shell centrality of the node u by using the k shell value of u , the k shell value of its neighbors ( v ), and edge weight ( w uv ) between them. We model edges present in the network as springs and edge weights as spring constants. Based on the notion of Hooke's law of elasticity, we assume a force equal to the weighted k shell value acts on each node. In this arrangement, we formulate the KSHR centrality of each node using associated weighted k shell value and the equivalent edge weight by taking care of series and parallel combination of edges up to 3 hop neighbors from the source node. The proposed algorithm finds influential nodes that can spread the information to the maximum number of nodes in the network. We compare our proposed algorithm with popular existing algorithms and observe that it outperforms them on many real life and synthetic networks suing Susceptible Infected Recovered (SIR) information diffusion model.


Deformed logarithms. Associated entropic divergences. Applications to linear inverse problems. Inversion algorithms. This work belongs to the framework of inverse problems with linear model. The resolution of this type of problem consists in minimizing (possibly under constraints) a function of discrepancy between the measurements and a physical model of the considered phenomenon. We will here extend this study to divergence functions based on forms of entropy developed in the field of Statistical Physics. These various forms of entropy are based on "the deformed algebra" 9 and in particularly on the notion of "Deformed Logarithm" 15 9 .


Unmasking the Mask Evaluating Social Biases in Masked Language Models. Masked Language Models (MLMs) have shown superior performances in numerous downstream NLP tasks when used as text encoders. Unfortunately, MLMs also demonstrate significantly worrying levels of social biases. We show that the previously proposed evaluation metrics for quantifying the social biases in MLMs are problematic due to following reasons (1) prediction accuracy of the masked tokens itself tend to be low in some MLMs, which raises questions regarding the reliability of the evaluation metrics that use the (pseudo) likelihood of the predicted tokens, and (2) the correlation between the prediction accuracy of the mask and the performance in downstream NLP tasks is not taken into consideration, and (3) high frequency words in the training data are masked more often, introducing noise due to this selection bias in the test cases. To overcome the above mentioned disfluencies, we propose All Unmasked Likelihood (AUL), a bias evaluation measure that predicts all tokens in a test case given the MLM embedding of the unmasked input. We find that AUL accurately detects different types of biases in MLMs. We also propose AUL with attention weights (AULA) to evaluate tokens based on their importance in a sentence. However, unlike AUL and AULA, previously proposed bias evaluation measures for MLMs systematically overestimate the measured biases, and are heavily influenced by the unmasked tokens in the context.


Algebraicity of critical values of adjoint L functions for rm GSp 4 . We prove an algebraicity result for certain critical value of adjoint L functions for rm GSp 4 over a totally real number field in terms of the Petersson norm of normalized generic cuspidal newforms on rm GSp 4 . This is a generalization of our previous result arXiv 1902.06429.


Optimized scintillation strip design for the DANSS upgrade. DANSS is a one cubic meter plastic scintillator detector with a primary goal of the sterile neutrino searches at a commercial nuclear reactor. Due to its highly advantageous location, fine segmentation and ability to change the distance to the neutrino production origin DANSS is ahead of many similar experiments around the world in terms of the counting rate, signal to background ratio and sterile neutrino exclusion regions. Yet a moderate energy resolution of the detector prevents the further progress in the physics program. The main challenge of the planned upgrade is to achieve the energy resolution of 12 at 1 MeV. The new design of the main sensitive element the plastic scintillation strip is the most important step forward. The strip prototypes were manufactured and tested at the pion beam of the PNPI synchrocyclotron. More than twice higher light output together with fairly flat detector response uniformity, longitudinal timing information and other optimizations will surely help to reach the upgrade goal. The paper discusses the drawbacks of the current strip version, outlines the new features of the proposed upgrade, describes the beam test procedure and presents the test results reflecting the advantages of the new strip design in comparison with the currently used version.


"Is depression related to cannabis?" A knowledge infused model for Entity and Relation Extraction with Limited Supervision. With strong marketing advocacy of the benefits of cannabis use for improved mental health, cannabis legalization is a priority among legislators. However, preliminary scientific research does not conclusively associate cannabis with improved mental health. In this study, we explore the relationship between depression and consumption of cannabis in a targeted social media corpus involving personal use of cannabis with the intent to derive its potential mental health benefit. We use tweets that contain an association among three categories annotated by domain experts Reason, Effect, and Addiction. The state of the art Natural Langauge Processing techniques fall short in extracting these relationships between cannabis phrases and the depression indicators. We seek to address the limitation by using domain knowledge specifically, the Drug Abuse Ontology for addiction augmented with Diagnostic and Statistical Manual of Mental Disorders lexicons for mental health. Because of the lack of annotations due to the limited availability of the domain experts' time, we use supervised contrastive learning in conjunction with GPT 3 trained on a vast corpus to achieve improved performance even with limited supervision. Experimental results show that our method can significantly extract cannabis depression relationships better than the state of the art relation extractor. High quality annotations can be provided using a nearest neighbor approach using the learned representations that can be used by the scientific community to understand the association between cannabis and depression better.


A Quantitative Framework for Network Resilience Evaluation using Dynamic Bayesian Network. Measuring and evaluating network resilience has become an important aspect since the network is vulnerable to both uncertain disturbances and malicious attacks. Networked systems are often composed of many dynamic components and change over time, which makes it difficult for existing methods to access the changeable situation of network resilience. This paper establishes a novel quantitative framework for evaluating network resilience using the Dynamic Bayesian Network. The proposed framework can be used to evaluate the network's multi stage resilience processes when suffering various attacks and recoveries. First, we define the dynamic capacities of network components and establish the network's five core resilience capabilities to describe the resilient networking stages including preparation, resistance, adaptation, recovery, and evolution the five core resilience capabilities consist of rapid response capability, sustained resistance capability, continuous running capability, rapid convergence capability, and dynamic evolution capability. Then, we employ a two time slices approach based on the Dynamic Bayesian Network to quantify five crucial performances of network resilience based on core capabilities proposed above. The proposed approach can ensure the time continuity of resilience evaluation in time varying networks. Finally, our proposed evaluation framework is applied to different attacks and recovery conditions in typical simulations and real world network topology. Results and comparisons with extant studies indicate that the proposed method can achieve a more accurate and comprehensive evaluation and can be applied to network scenarios under various attack and recovery intensities.


Minimum Stable Cut and Treewidth. A stable cut of a graph is a cut whose weight cannot be increased by changing the side of a single vertex. Equivalently, a cut is stable if all vertices have the (weighted) majority of their neighbors on the other side. In this paper we study Min Stable Cut, the problem of finding a stable cut of minimum weight, which is closely related to the Price of Anarchy of the Max Cut game. Since this problem is NP hard, we study its complexity on graphs of low treewidth, low degree, or both. We show that the problem is weakly NP hard on severely restricted trees, so bounding treewidth alone cannot make it tractable. We match this with a pseudo polynomial DP algorithm running in time ( Delta cdot W) O(tw) n O(1) , where tw is the treewidth, Delta the maximum degree, and W the maximum weight. On the other hand, bounding Delta is also not enough, as the problem is NP hard for unweighted graphs of bounded degree. We therefore parameterize Min Stable Cut by both tw Delta and obtain an FPT algorithm running in time 2 O( Delta tw) (n log W) O(1) . Our main result is to provide a reduction showing that both aforementioned algorithms are essentially optimal, even if we replace treewidth by pathwidth if there exists an algorithm running in (nW) o(pw) or 2 o( Delta pw) (n log W) O(1) , then the ETH is false. Complementing this, we show that we can obtain an FPT approximation scheme parameterized by treewidth, if we consider almost stable solutions. Motivated by these mostly negative results, we consider Unweighted Min Stable Cut. Here our results already imply a much faster exact algorithm running in time Delta O(tw) n O(1) . We show that this is also probably essentially optimal an algorithm running in n o(pw) would contradict the ETH.


Elementary Proofs of Infinitely Many Congruences for k Elongated Partition Diamonds. In 2007, Andrews and Paule published the eleventh paper in their series on MacMahon's partition analysis, with a particular focus on broken k diamond partitions. On the way to broken k diamond partitions, Andrews and Paule introduced the idea of k elongated partition diamonds. Recently, Andrews and Paule revisited the topic of k elongated partition diamonds. Using partition analysis and the Omega operator, they proved that the generating function for the partition numbers d k(n) produced by summing the links of k elongated plane partition diamonds of length n is given by frac (q 2 q 2) infty k (q q) infty 3k 1 for each k geq 1. A significant portion of their recent paper involves proving several congruence properties satisfied by d 1, d 2 and d 3 , using modular forms as their primary proof tool. In this work, our goal is to extend some of the results proven by Andrews and Paule in their recent paper by proving infinitely many congruence properties satisfied by the functions d k for an infinite set of values of k. The proof techniques employed are all elementary, relying on generating function manipulations and classical q series results.


Faster Algorithms for Rooted Connectivity in Directed Graphs. We consider the fundamental problems of determining the rooted and global edge and vertex connectivities (and computing the corresponding cuts) in directed graphs. For rooted (and hence also global) edge connectivity with small integer capacities we give a new randomized Monte Carlo algorithm that runs in time tilde O (n 2) . For rooted edge connectivity this is the first algorithm to improve on the Omega(n 3) time bound in the dense graph high connectivity regime. Our result relies on a simple combination of sampling coupled with sparsification that appears new, and could lead to further tradeoffs for directed graph connectivity problems. We extend the edge connectivity ideas to rooted and global vertex connectivity in directed graphs. We obtain a (1 epsilon) approximation for rooted vertex connectivity in tilde O (nW epsilon) time where W is the total vertex weight (assuming integral vertex weights) in particular this yields an tilde O (n 2 epsilon) time randomized algorithm for unweighted graphs. This translates to a tilde O ( kappa nW) time exact algorithm where kappa is the rooted connectivity. We build on this to obtain similar bounds for global vertex connectivity. Our results complement the known results for these problems in the low connectivity regime due to work of Gabow 9 for edge connectivity from 1991, and the very recent work of Nanongkai et al. 24 and Forster et al. 7 for vertex connectivity.


Lattice Design and Dynamic Aperture Studies for the FCC ee Top Up Booster Synchrotron. The Future Circular Collider (FCC) study investigates the feasibility of circular colliders in the post LHC era. The sub study FCC ee is a 100 km electron positron collider in the energy range of 90 365 GeV. In order to achieve a design luminosity in the order of 10 36 cm 2 s 1 continuous top up injection is required. The injector chain therefore includes a 100 km booster synchrotron in the same tunnel as the collider rings. This paper presents the lattice design of this booster synchrotron and the first dynamic aperture studies based on the chromaticity correction sextupole scheme.


External Service Sensing (ESS) Research Framework, Challenges and Opportunities. The flourish of web based services gave birth to the research area textit services computing , a rapidly expanding academic community since nearly 20 years ago. Consensus has been reached on a set of representative research problems in services computing, such as service selection, service composition, service recommendation, and service quality prediction. An obvious fact is that most services keep constant changes to timely adapt to changes of external business technical environment and changes of internal development strategies. However, traditional services computing research does not consider such changes sufficiently. Many works regard services as textit static entities this leads to the situation that some proposed models algorithms do not work in real world. Sensing various types of service changes is of great significance to the practicability and rationality of services computing research. In this paper, a new research problem textit External Service Sensing (ESS) is defined to cope with various changes in services, and a research framework of ESS is presented to elaborate the scope and boundary of ESS. This framework is composed of four orthogonal dimensions sensing objects, sensing contents, sensing channels, and sensing techniques. Each concrete ESS problem is defined by combining different values in these dimensions, and existing research work related to service changes can be well adapted to this framework. Real world case studies demonstrate the soundness of ESS and its framework. Finally, some challenges and opportunities in ESS research are listed for researchers in the services computing community. To the best of our knowledge, this is the first time to systematically define service change related research as a standard services computing problem, and thus broadening the research scope of services computing.


ATLANTIS A Benchmark for Semantic Segmentation of Waterbody Images. Vision based semantic segmentation of waterbodies and nearby related objects provides important information for managing water resources and handling flooding emergency. However, the lack of large scale labeled training and testing datasets for water related categories prevents researchers from studying water related issues in the computer vision field. To tackle this problem, we present ATLANTIS, a new benchmark for semantic segmentation of waterbodies and related objects. ATLANTIS consists of 5,195 images of waterbodies, as well as high quality pixel level manual annotations of 56 classes of objects, including 17 classes of man made objects, 18 classes of natural objects and 21 general classes. We analyze ATLANTIS in detail and evaluate several state of the art semantic segmentation networks on our benchmark. In addition, a novel deep neural network, AQUANet, is developed for waterbody semantic segmentation by processing the aquatic and non aquatic regions in two different paths. AQUANet also incorporates low level feature modulation and cross path modulation for enhancing feature representation. Experimental results show that the proposed AQUANet outperforms other state of the art semantic segmentation networks on ATLANTIS. We claim that ATLANTIS is the largest waterbody image dataset for semantic segmentation providing a wide range of water and water related classes and it will benefit researchers of both computer vision and water resources engineering.


Characterization of rectifiability via Lusin type approximation. We prove that a Radon measure mu on mathbb R n can be written as mu sum i 0 n mu i , where each of the mu i is an i dimensional rectifiable measure if and only if for every Lipschitz function f mathbb R n to mathbb R and every varepsilon 0 there exists a function g of class C 1 such that mu( x in mathbb R n g(x) neq f(x) ) varepsilon .


Hennessy Milner Properties via Topological Compactness. We give Hennessy Milner classes for intuitionistic, dual intuitionistic and bi intuitionistic logic interpreted in intuitionistic Kripke models, and generalise these results to modal (dual and bi )intuitionistic logics. Our main technical tools are image compact and pre image compact relations that provide a semantical description of modal saturation properties.


Model Extraction and Adversarial Attacks on Neural Networks using Switching Power Information. Artificial neural networks (ANNs) have gained significant popularity in the last decade for solving narrow AI problems in domains such as healthcare, transportation, and defense. As ANNs become more ubiquitous, it is imperative to understand their associated safety, security, and privacy vulnerabilities. Recently, it has been shown that ANNs are susceptible to a number of adversarial evasion attacks inputs that cause the ANN to make high confidence misclassifications despite being almost indistinguishable from the data used to train and test the network. This work explores to what degree finding these examples maybe aided by using side channel information, specifically switching power consumption, of hardware implementations of ANNs. A black box threat scenario is assumed, where an attacker has access to the ANN hardware's input, outputs, and topology, but the trained model parameters are unknown. Then, a surrogate model is trained to have similar functional (i.e. input output mapping) and switching power characteristics as the oracle (black box) model. Our results indicate that the inclusion of power consumption data increases the fidelity of the model extraction by up to 30 percent based on a mean square error comparison of the oracle and surrogate weights. However, transferability of adversarial examples from the surrogate to the oracle model was not significantly affected.


Optimal Algorithms for Private Online Learning in a Stochastic Environment. We consider two variants of private stochastic online learning. The first variant is differentially private stochastic bandits. Previously, Sajed and Sheffet (2019) devised the DP Successive Elimination (DP SE) algorithm that achieves the optimal O biggl( sum limits 1 le j le K Delta j 0 frac log T Delta j frac K log T epsilon biggr) problem dependent regret bound, where K is the number of arms, Delta j is the mean reward gap of arm j , T is the time horizon, and epsilon is the required privacy parameter. However, like other elimination style algorithms, it is not an anytime algorithm. Until now, it was not known whether UCB based algorithms could achieve this optimal regret bound. We present an anytime, UCB based algorithm that achieves optimality. Our experiments show that the UCB based algorithm is competitive with DP SE. The second variant is the full information version of private stochastic online learning. Specifically, for the problems of decision theoretic online learning with stochastic rewards, we present the first algorithm that achieves an O left( frac log K Delta min frac log K epsilon right) regret bound, where Delta min is the minimum mean reward gap. The key idea behind our good theoretical guarantees in both settings is the forgetfulness, i.e., decisions are made based on a certain amount of newly obtained observations instead of all the observations obtained from the very beginning.


Secure Bayesian Federated Analytics for Privacy Preserving Trend Detection. Federated analytics has many applications in edge computing, its use can lead to better decision making for service provision, product development, and user experience. We propose a Bayesian approach to trend detection in which the probability of a keyword being trendy, given a dataset, is computed via Bayes' Theorem the probability of a dataset, given that a keyword is trendy, is computed through secure aggregation of such conditional probabilities over local datasets of users. We propose a protocol, named SAFE, for Bayesian federated analytics that offers sufficient privacy for production grade use cases and reduces the computational burden of users and an aggregator. We illustrate this approach with a trend detection experiment and discuss how this approach could be extended further to make it production ready.


Quantum K theory and q Difference equations. This is a set of lecture notes for the first author's lectures on the difference equations in 2019 at the Institute of Advanced Study for Mathematics at Zhejiang University. We focus on explicit computations and examples. The convergence of local solutions is discussed.


An L p weak Galerkin method for second order elliptic equations in non divergence form. This article presents a new primal dual weak Galerkin method for second order elliptic equations in non divergence form. The new method is devised as a constrained L p optimization problem with constraints that mimic the second order elliptic equation by using the discrete weak Hessian locally on each element. An equivalent min max characterization is derived to show the existence and uniqueness of the numerical solution. Optimal order error estimates are established for the numerical solution under the discrete W 2,p norm, as well as the standard W 1,p and L p norms. An equivalent characterization of the optimization problem in term of a system of fixed point equations via the proximity operator is presented. An iterative algorithm is designed based on the fixed point equations to solve the optimization problems. Implementation of the iterative algorithm is studied and convergence of the iterative algorithm is established. Numerical experiments for both smooth and non smooth coefficients problems are presented to verify the theoretical findings.